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出 版 说 明 


21 世 纪 初 的 5 至 10 年 是 我 国 国民 经 济 和 社会 发 展 的 重要 时 期 ， 也 是 信息 产业 快速 发 展 的 关 多 
时 期 "在 我 国 加 入 WTO 后 的 今天 , 培养 一 支 适应 国际 化 竞争 的 一 流下 人 才 队 全 是 我 国 高 等 教育 的 
重要 任务 之 一 。 信 息 科 学 和 技术 方面 人 才 的 优 劣 与 多 寒 ， 是 我 国 面 对 国 际 竞争 时 成 败 的 关键 因素 ， 

当前 , 正 值 我 国 高 等 教育 特别 是 信息 科学 领域 的 教育 调整 、 变革 的 重大 时 期 , 为 使 我 国教 育 体 
制 了 国际 化 接轨 ,有 条 件 的 高 等 院 校正 在 为 某 些 信息 学 科 和 技术 课程 使 用 国外 优秀 教材 和 优秀 斥 版 
教材 ， 以 使 我 国 在 计算 机 教学 上 尽快 赶 上 国际 先进 水 平 。 

电子 工业 出 版 社 乘 承 多 年 来 引进 国外 优秀 图 书 的 经 验 ， 翻 译 出 版 了 “国外 计算 机 科学 教材 系 
列 ” 从 睛 ,这 套 教材 获 盖 学 科 范 围 广 、 领 域 宽 、 层 次 多 ， 既 有 本 科 专 业 课程 教材 ， 也 有 研究 牛 课程 
教材 ， 以 适应 不 同 院 系 、 不 同 专业 、 不 同 层次 的 师 生 对 教材 的 需求 , 广大 师 生 可 月 由 选择 和 自由 组 
合 使 用 。 这些 教 材 涉及 的 学 科 方向 包括 网 络 与 通信 、 操作 系统 、 计算 机 组 织 与 结构 、 算 法 与 数据 结 
构 、 数 据 库 与 信息 处 理 、 编 程 语言 、 图 形 图 像 与 多 媒体 、 软 件 工程 等 。 同时 , 我 们 也 适当 引进 了 -- 
些 优秀 英文 原版 教材 , 本 着 翻译 版 本 和 英文 原版 并 重 的 原则 , 对 重点 图 书 既 提供 英文 原版 又 提供 相 
应 的 翻译 版 本 。 

在 妊 书 选 题 上 ， 我 们 大 都 选择 国外 著名 出 版 公司 出 版 的 高 校 教材 ， 如 Pearson Education 培 生 教 
育 出 版 集团 、 麦 格 劳 - 希 尔 教育 出 版 集团 、 麻 省 理工 学 院 出 版 社 、 剑桥 大 学 出 版 社 等 。 撰 写 教材 的 
许多 作者 都 是 翡 声 世 界 的 教授 .学 者 ,如 道格拉斯 . 科 默 Douglas E. Comer )、 威廉 斯 托 林 斯 ( Wiliam 
Stallings )、 哈 维 ' 戴 特 尔 ( Harvey M. Deitel )、 尤 利 斯 . 布 菜 克 (Uyless Black ) 等 。 

为 确保 教材 的 选 题 质 量 和 翻译 质量 , 我 们 约请 了 清华 大 学 、 北 京 大 学 、 北京 航空 航天 大 学 、 复 
旦 大 学 上海 交通 大 学 、 南 京 大 学 、 浙 江 大 学 、 险 尔 滨 工 业 大 学 、 华 中 科技 大 学 、 西 安 交通 大 学 ， 
国防 科学 技术 大 学 、 解 放 军 理工 大 学 等 著名 高 校 的 教授 和 骨干 教师 参与 了 本 系列 教材 的 选 题 .翻译 
和 审 校 工作 。 他 们 中 既 有 讲授 同类 教材 的 骨 二 教师、 博士 , 也 有 积累 了 几 十 年 教学 经 验 的 老 教授 和 
博士 生 导 师 。 

在 该 系列 教材 的 选 题 、 翻 译 和 编辑 加 工 过 程 中 ,为 提高 教材 质量 , 我 们 做 了 大 量 细致 的 工作 
包括 对 所 选 教材 进行 全 面 论证 ; 选择 编辑 时 力求 达到 专业 对 口 ; 对 排版 、 印 制 质量 进行 严格 把 关 - 
对 于 灿 文 教材 中 出 现 的 错误 ， 我 们 通过 与 作者 联络 和 网 上 下 载 勘误 表 等 方式 ， 逐 -进行 了 修订 、 

此 外 , 我 们 还 将 与 国外 著名 出 版 公司 合作 ， 提供 --- 些 教材 的 教学 支持 资料 , 希望 能 为 授课 老师 
提供 帮助 。 今 后 , 我 们 将 继续 加 强 与 各 高 校 教师 的 密切 联系 ， 为 广大 师 生 引进 更 多 的 国外 优秀 教材 
和 参考 书 ， 为 我 国 计 算 机 科学 教学 体系 与 国际 教学 体系 的 接轨 做 出 努力 
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Preface 


This book provides a fundamental introduction to numerical analysis Suitabjle for un- 
dergraduate students in mathematics, computer science, Physical sciences, and engi- 
neering， It is assumed that the reader is familiar with calculus and has taken a struc- 
tured programming course. The text has enough material fitted modularly for either a 
Single-term course or a year Sequence. In short, the book contains enough material So 
instructors will be able to select topics appropriate to their needs. 

Students of various backgrounds should find numerical methods duite interesting 
and useful, and this is kept in mind throughout the book. Thus, there is a wide vari- 
ety of examples and problems that help to sharpen one's skill in both the theory and 
Practice of numerical analysis. Computer calculations are Presented in the form of ta- 
bles and graphs whenever possible so that the resulting numerical approximations are 
easierto visualize and interpret. MATLAB programs are the vehicle for presenting the 
underlying numerical algorithms. 

Emphasis is placed on understanding why numerical methods work and their lim- 
itations，This is challenging and involves a_ balance between theory，error analysis， 
and readability，An error analysis for each method is presented in a fashion that is 
appropriate for the method at hand, yet does not turn off the reader A _ mathematical 
derivation for each method is given that uses elementary results and builds the student's 
understanding of calculus，Computer assignments using MATLAB give students an 
opPportunity to practice their skills at scientific programming. 

Shorter numerical exercises can be carried out with a pocket calculatorcompnuter， 
and the longer ones can be done using MATLAB subroutines. It is left for the instruc- 
tor to guide the students regarding the pedagogical use of numerical computations， 
Fach instructor can make assignments that are approprniate to the available comput- 





ing resources. Experimentation with the MATLAB subroutine libraries is encouraged. 
These materials can be used to assist students in the compjletion of the numerical anal- 
ysSls component of computer laboratory exercises. 

This Third Edition grows out of much polishing of the narrative for the Second 
Pdition. For example. the OCR method has been added to the chapter on Eigenvalues 
and Eigenvyectors. New to this edition is the explicit use of the software MATLAB. 
An appendix gives an introduction to MATLAB Syntax. Exampjles have been added 
throughout the text with MATLAB and compiete MAILAB programs are given in 
each section. An instructor's disk is available upon request from the publisher, 

Previously we took the attitude that any software program that students mastered 
would work fine，However many Students entering this course have yet to master a 
Programming language (Computer Science students excepted). MATLAB has become 
the tool of nearly all engineers and applied miathematicians, and its newest versiong 
have Improved the programming aspects. So we think that students will have an easier 
and more productive time in this MATLAB version of our text 
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Preliminaries 


Consider the function F(xz) 一 cos(xz), its derivative 户 (xz) = sin(x), and its an- 
tiderivative 严 (x) 一 Sin(x) 十 C. These formulas were studied in calculus. The former 
is usedto determine the sijopemu 一 fxo) ofthe curvey = Foxc) atapoint (xzo，F(xzo))， 
and the latter is used to compnute the area under the curvefora <Y<<. 

The slope at the point (r/2,0) 六 = 庆 Cr/2) = 1andcanbeusedto fndthe 
tangent line at this point (see Figure 1.1(a)): 


nk 习 to=7G)G 瑟 - 


Figure 11 (a) The tangent line to 
the curve y 一 cos(xz) at the point 
( 亚 /2,0). . 
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》 了 = coSGOD 
0.5 


0.0 


Figure 1.1 《(b) The area under the 
cuUrve y 三 COS(C) over the interval 
fi, r/2]. 


The area under the curve for 0 < x < T/2 is computed using an integral (see Fig- 
ure 1.1(b): 


area 一 三 CoS(x) dx 一 下 (了 ) 下 (0) = Sin (5) 0 三 1. 


These are Some of the results that we will need to use from calculus. 


Review of Calculus 


His assumed that the reader is familiar with the notation and subject matter covered in 
the undergraduate calculus sequence. This should have included the topics of limits， 
continuity, differentiation, integration, sequences, and series. Throughout the book we 
refer to the following results. 


Limits and Continuity 


Definition 1.1. Assume that 太 (x) is deftined on a set S of real numbers. Then 矿 is 
Said to have the zzzt EL atx 一 X0oand we Write 


(D lim jx) = 工 ， 

ZX 一 0 
it given anye > 0, there exists a6 > 0 Such that, wheneverxy e 8$,0<I xxol<' 
implies that |Jx) Z| < ese，When the mn-increment notation xy 一 x0 十 Pis used， 


equation (1) becomes 


OO) Jim Jo + 月 = 也 和 





SEC. 1.1 REVIEW OF CALCULUS 3 


Deftinition 1.2，， Assume that 1(xc) is defined on aset S ofreal numbers and let xo0 E 49. 
Then 太 is said to be coataroOS QtX 一 x0 直 


G) Jim FoD = Jeo)， 


The function jis Saidq to be continuous on S if it is continuous at each point x E 9. 
The notation C"(S) stands for the set of all functions 矿 such that 三 and its first 7 
derivatives are continuous on 9 When S is an interval, Say [a, 站 ], then the notation 
C"[a,pb] is used，As an example，consider the function Fox) = x4/3 on the inter- 
val [ 1 1]、Clearly，FOoc) and PFCx) = (4/3)xL3 are continuous on [ 1, 1], while 
(xz) = (4/9)xz 203 isnot continuous atx = 0. 全 


Definition 1.3， Suppose that {xnj221is an infinite sequence. Then the sequence is 
Said to have the limit 元, and we write 


(4) Hm xn 一 工 ， 
用 一 > CO 


it given any e > 0, there exists a positive integer N = N(e) such thatm > N implies 
that |xzn 世 | < 6. 全 


When a Sequence has a limit，we Say that it is a Comtyerge1af SegUe1ice，、Another 
commonjy used notation is “xn 一 也 as7 一 co”Equation (4) is equivalent to 


(5) lim (xn 工 ) = 0. 
天 一 OO 
Thus we can View the Sequence {en] 沁 1] 一 {xr 工 ]j?2.1 as an error Segtentce、The 


following theorem relates the concepts of continuity and convergent sequence. 


Theorem 1.1。 Assume that zx) is defined on the set S and X0 E S$. The following 
Statements are equivalent: 


6 (al) The function 广 is continuous at x0, 

(0) 、 __ ， __ 
(b) 下 ji。 2 一 X0, then jam Joxn) = (x0). 

Thbeorem 1.2 (Intermediate Value Theorem)， Assume that f e Cfa,5] and 民 is 


any number between Fa) and (0)， Then there exists a number c, with ce (a, 中 ， 
Such that 广 (c) 三 世 . 


Example 1.1. The function fx) = cos(r lis continuous over [0, 1], and the constant 
了 三 0.8 E (cos(0), cos(1)). The solution to 太 x) = 0.8 over [0, 1] is cl = 0.3S6499. 
Similarly， 太 (x) is continuous over [1,2.$],and 世 三 0.8 e (cos(2.$), cos(1)). The solution 
to jx) = 0.8 over [1,2.3] is cz = 1.643502. These two cases are shown in Figure 1.2，@@ 
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了 》 
y = 
Figure 1.2 The intermediate value 
theorem applied to the function 
xY rr)=cosGk 1) over [0,1] and 
c10.5 1.0 1.5 c7 2.0 2.5 over the interval [1, 2.5] 
7 Go) 


(ao) y=/on 


(人 用 轧 ) 


Figure 1.3 The extreme value 
theorem applied to the function 
x JoD)=35+59.Sxz 66.$x2 十 1$x3 
0.0 0.5 1.0 1.S 2.0 2.5 3.0 Over the interval [0， 3]. 


Theorem 1.3 (上 xtreme Value Theorem for a Continuous Functiom)。 Assume that 
JE C[a,b]， Then there exists a ljower bound M1, an upper bound M2，and two 
numbers xl1, X2 e [a, p] such that 


(7) hd = Je < JJ) < Go) =M2 whenever x e [a,D， 
We Sometimes express this by writing 


G) Mi= JeD= mintfCD] and Ma=JGoa)= maxffCo) 


Differentiablie Functions 


Definition 1.4， Assume that (xz) is deftned on an open interval containing xo. Then 
Jis said to be differentiable at xo 让 


Tinm jx) Fo) 


ZX 一 X0 X 2X0 


(9) 
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exists. When this limit exijsts, it is denoted by F(xo) andis called the derzratiyve of 
at x0. An equivalent way to express thls limit ls to use the P-increment notation: 


.jxo 十 四 eco) / 

lim 一 一 一 一 一 一 = . 

〈10) im jxo) 
A function that has a derivative at each point in a set $ is said to be djferertiabie 

on $. Note that, the number mm = 广 (xo) is the slope ofthetangent line to the graph of 


the function y = (xz) at the point (x0，F(xo))， 全 


Thbheorem 1.4， 开 fx) is differentiable atx = xo,then F(x) is continuous at x 一 50， 


It follows from Theorem 1.3 that 过 a function 厂 i differentiable on a closed 
interval [a, p],then its extreme values occur at the end points of the interval or at the 
critical points (solutions of 太 'G) = 0) in the open interval (ac, 站). 


Example 1.2. The function 让 (zx) 一 15$x3 66.Sx2 二 S9.5Sx 十 3S is differentiable on [0, 3]. 
The solutions to _ 广 (x) = 4Sx2 123x 十 59.5 = 0 are xl = 0.S4955 and xz2 一 2.40601. 
The maximum and minimum values of 矿 on f0, 3] are: 


min{.F(0), /3)， fc， Ga)} = min{35, 20, 50.10438, 2.11850] = 2.11850 


and 


max{(0),，AG3)， /xD zc) = max(35, 20, 530.10438, 2.11850] = 50.10438.， 旧 


Theorem 1.S (Rolle”s Theorem). Assume that F < C[a,p] andthat (xz) exists for 
allxr e(a,p).IFa)= Fo) = 0,thenthere exists anumber c, with ce (&, p), Such 
that 广 (c) = 0. 


Theorem 1.6 (Mean Value Theorem)， Assume that A es Cra,Dp] and that 六 (xz) 
exists for all x ec (a, 站). Then there exists a number c, with c < (a, 站 ), such that 


jg 
7 


Geometrically, the Mean Value Theorem says that there is at least one number 
ce (a,p) Such that the slope of the tangent line to the graph of y 王 太 (x) at the point 
(c, jc)) equals the Slope of the secant line through the points (G, F (a)) and (b， 矿 ( 思 ). 


(19) 广 (c) = 


Example 1.3， The function fx) = Sin(x) is continuous on the closed interval [0.1, 2.1] 

and differentiable on the open interval (0.1, 2.1). Thus, by the Mean Value Theorem, there 

is anumber c Such that 

三 CC.1) 0.1 _ 0.863209 “0.099833 
21 01 2.1 0.1 

The solution to 广 (c) = cos(c) = 0.381688 in the interval (0.1, 2.1) is c = 1.179174. 


The graphs of jx),， the Secant line y = 0.381688x 十 0.099833, and the tangent line 
yy 一 0.381688x 十 0.47421S are shown in Figure 1.4. . 国 


久 (c) = = 0.381688. 
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帮 a) 





名 0.5 40 < I.5 2.0 访 


Rigure 1.4 The mean value theorem applied to xc) 一 
sin(G) over the interval [0.1, 2.11. 


Theorern 1.7 (Generalized Rolexs Theorem)， Assunme that 矿 < Cfa,5] and that 
OFCr， .FDC exist over (ab) and z0, xl xn e [ab 下 (xi 门 =0 
fory = 0, 1 . ,nthenthereexjsts anumberc, with c ce (a, 世 ,such that 六 0(c) = 0. 


JIntegrals 


Theorem 1.8 (First Fundamental Theorem)， If is continuous over [ae,D and 
is any antiderivative of fon fa,bj, then 


尼 
(12) 1 Fax 一 (D) Fa) where FICc) 一 了 Ce) 


Theorete .9 (Second Fundarmental Theorena)j， 下 三 is cohtinaous Over fa, 5 and 
YX E fa 臣 ,then 


码 放 
(13) 反 / jd 一) 


开 xXaznpje 了 4， Thbe fanction Frx) 一 cos(X) Satisfes the hypotheses of Theorem 1.9 over 
the interval f0,T/2],thus by the chain rule 


本 


lf 
人 cos( 人 dlL 一 cos(C2)(r27 = 2x7 cos(x 人 2 、 要 
f 


Theorem 1.10 (Mean Value Theorem for JIntegrals)， Assume that 了 了 ce Cf[a,pb]. 
Then there exXists a namber c, with c E (ap ,such 也 at 


坊 
二 7 dx = ec). 


Thbe yalue fc) is the avyerage valaue of 1 over the interval [4 中. 


RE 
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> = 2 


0.8 


0.6 


0.4 


0.2 


Figure 1.S The mean value 
theorem for integrals applied to 


0.0 YY xx) = sin(x) 十 地 sin(3x) over the 
0.0 0.5 1.0 1.S 2.0 2.5 interval [0, 2.5]. 


Example 1.S. The function F(x) = Sin(x) 十 了 sin(3x) Satisfies the hypotheses of The- 
orem 1.10 over the interval [0,2.5].，An antiderivative of F(xz) is F(xz) 一 cos(x) 
cos(3x). The average value of the function 让 (x) over the interval [0, 2.5] is: 


] 2.5 Jond F(2.3) FF(O) 0.762629 (1.11111Db) 
一 -一 一 并 一 一 二 一 一 一 一 
25 0 几 25 25 

1.873740 
= 一 一 一 - 0.749496， 
25 2 


There are three solutions to the equation jc) = 0.749496 over the interval [0, 2.5]: 
cl = 0.440500, c2 = 1.268010, and c3 = 1.873383，The area of the rectangle with 
basebp 4 一 2.5 andheight fcj) = 0.749496 is fci) 地 aa) = 1.873740. The area 
of the rectangle has the same numerical value as the integral of (zx) taken over the inter- 
val [0, 2.5]. A comparison of the area under the curve 》 三 (xz) and that of the rectangle 
can be seen in Figure 1.5. 齐 


Theorem 1.11 (Weighted Integral Mean Value Theorem). Assume that 六 g < 
C[a,p] andg(x) > 0forx ee [a,pb]. Then there exists a number c, with ce (a, D)， 
such that 


b 
(14) 1 J kx)8() dx 三 17o 1/ SC) dx. 


Example 1.6， The functions foo) = sin(xr) and 8(c) 一 xz satisfy the hypotheses of 
Theorem 1.11 over the interval [0, r/2]. Thus there exists a numberc such that 
Txt2sinoodxz 1.14159 


sin(O) 一 22 29155 


= 0.883631 


orc = sin 1(0.883631) = 1.08356. 四 
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Series 


了 Definition 1.5S. Let {fanj22 1 be a sequence. Then > 1 an is an infinite series，The 


mth partial sum is S， = > 人 _] 4k、The infinite series cozzyersgesy if and only if the 
Sequence { Snj% 1 converges to alimit $, that is， 


形 
(15) im Sn 一 Im 2 4 = 4. 
I a series does not converge, we Say that it diyerges. 人 


， 1 
下 xample 1.7， Consider the infinite sequence {an]22 1 = | 元 | - Then the mth 
partial sum is nm 十 了 jw=-:1 


5 -六 (全 )-: 
”各 kt+D 各 +I/ + 


Therefore, the st of the infnite series is 





1 
= 人 ( ) =1 [| 
?一 oa 一 OO 妖 十 


Theorem 1.12 (Taylor's Theorem)， Assume that / <e C?+lfa,b] and let xzo < 
[a, 0].， Then, for every xz E (apD), there exists a number c 一 c(x) (the value of c 
depends on the value of x) that lies between xo and x Such that 


(10) J(x) 一 已 (xz) 十 Rio(x)， 
Where 
总 (如 ) 

(7) PPOO= 入 帮 名 oo 

类 一 0 
and 

Jo+D(c) ， 
(18) Ra(xr) 一 人 TOTC 0) + 


下 xample 1.8. The fonction F(x) = sin(x) satisfes the hypotheses of Theorem 1.12. The 
Taylorpolynomial Pr (x) of degreem 一 9expanded about xo = 0 is obtained by evaluating 
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Figure 1.6 ”The graph of fx) = Sin(x) and the Taylor 
polynomial P(xr) = xx3/3! 十 x5/S! xx7/1T1 十 X919!. 


the following derivatives at x = 0 and substituting the numerical values into formula (17). 


jc) = Sin(x)， J0) = 一 0， 
(Cr) = cos(z)， 大 (0) = 1， 
xz) = sin(xy)， (0) = 0， 

JQGCD = cosa)， GO = 1 


9)(xz) = cos(xz)， 丰 9)(0) = 1， 


xX5 XI7 2 


X3 
书 G) 王 可 十 可 记 十 机: 


A graph of both /and 证 overthe interval [0, 2r] is shown in Figure 1.6. 国 


Corollary 1.1， 工 已 (xz) is the Taylor polynomial of degreem given in Theorem 1.12， 
then 


(19) PW(xo) = Fl(xzo) for 大 一 0，1，...，7， 


Evaluation of a Polynomial 


Let the polynomial PP(x) of degree m have the form 


(20) Prz) = 一 anxz 二 an 1 工 +.: 十 aox2 十 alx 十 ao 
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orzers 1aetpod or Sy1tjetic dipisiom is a technique for evaluating polynormials， 工 
can be thought of as nested multiplication. For example, a fifth-degree polynomial can 
be written in the nested multiplication form 


上 (xx) 三 ((((G5 十 0G4) 十 03)7 十 Ga2)X 十 CI)X 十 60. 


Theorem 1.13 (Horners Method for Polynomial Evaluation)， Assume that PC) 
is the polynomial given in equation (20) andx 一 cis anumber for which P(c) is to be 
evaluated. 

Set or = an and compute 


(21) 不 一 必 十 cpk+l for 大 一 7 1 ， 2...，1， 0; 


then p0 = P(c). Moreover, 计 


(22) CoG) = 甸 xz 1+P tx 2 十 .十 pax2 十 pox 十 Bi， 
then 
(23) PU) 一 (人 cCoC) 二 Ro， 


Where @o(xj is the quotient polynomial of degreem 1and Ro = po 王 Pc)isthe 
remainder. 


Proof Substituting the right side of equation (22) for Co(x) and po for Ro in equa- 
tion (23) yjields 


PGD) = 人 ooxz 十 加 1 十: 十 扩 礁 十 bx 十 间 ) 十 b0 
(24) 一 boxz2 二 (po 1 cbo)xz2 工 十 十 (pz cb3)x2 
十 (pl cbz)x 十 (po cpl). 
The numbers bx are determined by comparing the coefficients of xx in equations (20) 
and (24), as Shown in Taple 1.1. 


The value P(c) = po is easily obtained by substituting x 一 c into equation (22) 
and using the fact that Ro 王 bp0: 


(24) P(c) 一 (C _ c)Oo(c) 十 Ro =50， @ 


The recursive formula for 和 given in (21) is easy to implement with a compnuter, 
Asimple algorithm is 


p(2) 一 400); 
for 上 = 一 nm 1 40 

DR 一 Ca(K) 十 c*#z(E 十 1; 
end 
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Table 1.1 “Coefcients mx for Horners Method 


Comparing (20) and (24) 


-Gan 一 pr 
Cr 1 一 疡 1 cpn 






Solving for 姑 






zu 三 an 
pr 1= 一 an 1 十 cbpn 









鸡 王 不 < 大 二 1 不 三 号 十 CBK+1 


2 =ao 十 cpi 


Table 1.2 “Hormer's Table for the Synthetic Division Process 





When Horners method is performed by hand, it is easier to write the coeffcients of 
P(x) on a line and perform the calculation pr = 以 十 cpk+l below ar in a column. 
The format for this procedure is ilustrated in Table 1.2. 


Exanple 1.9， Use Synthetic division (Horners method) to find P(3) for the polynomial 


PO=xz 6x4+8xr3 十 8x2 二 4r 40. 







05 CQ4 03 Q2 CI1 40 
] 6 8 8 4 40 
3 1S 


17 一 忆 (3) 王 50 


D5 2D4 2D3 pD2 BDI1 Output 


Therefore, P(3) 一 17. 国 
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了 Exercises for Reviev of Calculus 


1. (a) Find 工 lim oo(482 十 1 十 1). Then determine fc 三 人 zxr)andfind 


limn_ >coo en . 


(b) Find 二 1lim, (Cn2+6n 11/(422 二 27+1D. Then determine {fe} = 代 芭 ] 
and find lim >-o en. 


。Let {xnj?22 1 be a sequence such that limn_>oo xn 一 2. 


(al Find lim,_ >。o sin(xn). (b) Find limn_ oo ln(x2). 


。Find the number(s) c referred to in the intermediate value theorem for each function 


over the indicated interval and for the given value of 世 . 
(al (xz) 一 x2 十 2x 十 3over[ 1,0] using 工 一 2 
(b) xz) = wVx2I 5Sx 2over [6, 8] using 工 =3 


。Find the upper and lower bounds referred to in the extreme value theorem for each 


function over the indicated interval. 
(aj Foo)=x 3x+lover[ 1,2] 
(be) = cos2(r) sin(xz) overf0,2zr] 


。Find the number(s) c referred to in Rolle's theorem for each function over the indi- 


cated interval. 
(aj) jx) =x4 4x2over[ 2,2] 
(b) jx) = sin(x) 二 sin(2x) over [0,2rr] 


。Find the number(s) c referredto in the mean value theorem for each function over the 


indicated interval. 


(aj je) = VZ over[0,4] 
2 
(D) Fa) = -于 





7 over [0, H] 


7. Apply the generalized Rolle's theoremto Fox) =xG 1HD)C 3)overf0,3]. 


8. Apply the first fundamental theorem of calculus to each function over the indicated 


10. 


II. 





interval. 
(ax) =Xex over [0,2] 
3Y 
(bp) je = 元 十] over [ |] 
Apply the second fundamental theorem of calculus to each function,， 
(人 时 应 刀 cosO)di () 呈 庆 ed 


Find the number(s) c referred to in the mean value theorem for integrals for each 
function, overthe indicated interval. 


(alj) (xz) = 6xr2zover[ 3,4] 
(b) JJ(x) =xYcosG) over [0,3r7/2] 


Find the sum of each sequence or series. 
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1 12 2 1 
名 | 2 | _ ) | 3 | 

ee 3 dd es 1 
@ 2 TD ) 姜 本 1 


12. Find the Taylor polynomial of degree 7 = 4 for each function expanded about the 
given value of x0. 


(人 Fo)==vxzo=1 
() jz)=x 二 4t2 十 3f+ 十 1x0=0 
(jx)=cosGa),xo=0 
Given that F(x) = sin(z) and P(r) = xx313! 十 Y5/5! x7/T1 十 xz9/9|. Show that 
P 人 (0) = Fi(0) for = 1.2,...，,9. 
14. Use Synthetic division (Horner's method) to find P(c). 
(a]) Po) 一 x4+x3 13r2 7 12c=3 
(D) Po) 一 2x7+xe+x 2x4 xx 二 23,c= 1 


1S.， Find the average area of all circles centered at the origin with radii between 1 and 3. 


13 


16. Assunmae that a polynomial, 已 (x)，has 7 real roots in the interval fc, 5]，Show that 
Pw DU(z) has at least one real root in the interval [a, D]. 


17. Assume that 几 太 ,and are defined on the interval [a, p]; Fe) = 0) = 0; and 
jc) > 0forc e (a,D). Show that there is a numberd e (C,pb) such that F"(d) < 0. 


Binary Numbers 


Human beings do arithmetic using the decimal (base 10) number system. Most com- 
puters do arithmetic using the binary (base 2) number system. It may seem otherwise， 
since communication with the computer (inputoutpub is in base 10 numbers，This 
transparency does not mean that the computer uses base 10. In fact it converts inputs 
to base 2 (Or perhaps base 16), then performs base 2 arithmetic, and finally translates 
the answWer into base 10 before it displays a result, Some experimentation is required 
to verify this, One computer with nine decimal digits of accuracy gave the answer 


100,000 
(GD 》，0.1 = 9999.99447. 
人 一 | 


Here the intent was to add the number 古 repeatedly 100, 000times, The mathematical 
answer is exactly 10, 000. One goal is to understand the reason for the computers ap- 
parently fiawed calculation. At the end of this section, it will be shown how something 
is lost when the computer translates the decimal fraction 而 into abinary number. 
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Binary Nunmbers 


Base 10 numbers are used for most mathematical purposes. Forillustration, the number 
1S63 is expressible in expamded Jorma as 


1563 = (1x 103) 二 (5 x 10 人 7 +(6x 100 十 (3 x 100)， 


JIn general, let N denote a positive integer; then the digits ao, al, . ..， ak exist so that 
N has the base 10 expansion 


N=(akx1loo9+(k 1xloe 1 十 十 (alx100 二 (ao x100， 


Where the digits ak are chosen from {0, 1 ...,8,9}. Thus N is expressed in decimal 
notation as 


(2) N = CKQK 1….a201a0ten (decimal). 
Ifit is understood that 10 is the base, then (2) is written as 
AN = akrak 1… .aq20100， 


For example, we understand that 1$63 = 1S63ten. 
Using powers of 2, the number 1563 can be written 


1563= (1x2I0) 十 (Lx22)+(0x28) 二 (0x27) 十 (0x26) 
(3) 二 (0x25)+(Ix24)+(Lx23) 二 (0x22) 十 (1 x20 
十 (1Lx 20). 


This can be verified by performing the calculation 
1363 = 1024 十 $12 十 16 十 8 十 2 十 |. 


In general, let N denote a positive integer; the digits p0, b1, ...,bJ exist so that N 
has the base 2 expansion 


人 N=Grx2)+(O 1x27 0 二 + 人 ix20++(ox20)， 
whbere each digit pj is either a 0 or 1. Thus N is expressed in binary notation as 
(9) N 三 byJbJ 1……p2p1potwo (binary). 
Using the notation (S) and the result in (3) yields 

1363 = 11000011011ltwo. 


Remarks. The word “two”w 记 always be used as a subscript at the end of a binary 
number This will enable the reader to distinguish binary numbers from the ordinary 
base 10 usage. Thus 111 means one hundred eleven, whereas 111two stands for seven. 
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LI is usually the case that the binary representation for N will require more digits 
than the decimal representation. This is due to the fact that powers of 2 grow much 
more slowjly than do powers of 10， 

An efficient algorithm for fnding the base 2 representation of the integer N can be 
derived from equation (4). Dividing both sides of (4) by 2 yields 


N 必 
(9) 本 = xx27 DJ 二 (py 1x27 六 十 十 x29 十 记 ， 


Hence the remainder upon dividing N by 2, is the digit po. Now determine bp1. 王 (6) 
is written as W/2 三 Co 十 po/2,then 

0 8@o=(oyx2 0)+(r 1x27 二 十 (box20) 十 (bl x290). 

Now divide both sides of (7) by 2 to get 


鱼 = Orx27 习 + 1x24 习 二 二 2x 和 十 电 ， 


Hence the remainder upon dividing Co by 2, is the digit 1. This process is continued 
and generates sequences {Ckj and {pj of quotients and remainders, respectively. The 
process is terminated when an integer / is found such that CJ = 0. The sequences 
obey the following formulas; 
AN=20C0o 二 po 
@o 王 2C1I+DI 
(8) 


@yr2=26J 1 十 py 1 
@J 1=2@y 二 py (@y = 0)， 


卫 xample 1.10.， Show how to obtain 1563 = 11000011011、。. 
Start with N = 1563 and construct the quotients and remainders according to the 


equations in (8): 
1$63 一 2 x781 十 1， po=1 
781=2x390 二 1，2b=1 
390=2 xl195 十 0， 力 一 0 
199 =-2x 97 十 1， 83 一 1 
97=2x 48 十 1， pb 三 1 
48=2x 24+0， 5 三 0 
24==2x 12 二 0， pb =0 
Il2=2x 6++0，g 思 =0 
060=2x 3+0，p=0 
3=2x 1+1，pb=1 
1=2x 0+1，2pio= 三 1 


-一 一 一 一 一 一 一 一 一 -一 一 一 一 
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Thus the binary representation for 1S63 is 


1S63 = 站 0p928 .pp2p1potwo = 11000011011two。. 国 


Sequences and Series 


When rational numbers are expressed in decimal form, it is often the case that infinitely 
many digits are required. A familiar example is 


1 一 
(9) 了 3 二 0.3. 


Here the symbol3 means that the digit 3 is repeated foreverto form an infinite repeating 
decimal. It is understood that 10 is the base in (9)， Moreover it is the mathematical 
intent that (9) is the shorthand notation for the infinite series 


S=(3x1l0 D+(3xl03 二 .+(3x10 妆 十 .…. 
c2 1 
= 》 ,3(10) 上 一 二 ， 
类 一 1 3 


于 only a finite number of digits is displayed, then an approximation to 1/3 is obtained. 
For example, 1/3 六 0.333 = 333/1000. The error in this approximation is 1/3000. 
Using (10), the reader can verify that 1/3 = 0.333 十 1/3000. 

Itis important to understand the expansion in (10). A naive approach is to multiply 
both sides by 10 and then subtract, 


(10) 


108 =3 二 3xl0o 0D+Gx1l0 3 十 .二 (3x10 门 十 .…， 
4 一 (xl00D Gx1l0727)”.… (Gxl0 门 


9S=3 二 (0x10 D 上 +(Ox1l0 轨 上.… 二 (0Ox10 门 十 .…. 
Therefore, $ = 3/9 = 1/3. The theorems necessary to justify taking the difference 
between two infinite series can be found in most calculus books. A review of a few of 


the concepts follows, and the reader may want to refer to a standard text on calculus to 
fll in all the details. 


Definition 1.6 (Geometric Series)。 The infinite series 


ooe 
(11) >》 em 一 c+cr 十 cr2 十 十 cr 十 ， 


1 一 0 


wherec 天 0andr 天 0,is called ageomaetric series with ratio r. 公 
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Theorem 1.14 (Geometric Series). The geometric series has the following proper- 





tieS: 、 
e C 
1 一 
(12) 开 |zr| < L,then 》 cr = 本 一 
?一 0 
(13) 开 jr| > 1 then the series diverges. 


Proof The summation formula for a finite geometric Series is 





1 7 十 1 
(14) 5 =c+oteon+ +eom= 和 一 for r 拓 1 
To establish (12), observe that 
(15) Im<1 implies that lim ra+l = 0. 
开 一 CC 

Taking the limit as 7 一 oo, use (14) and (1$) to get 

im so 一 一 一 (1 im rt = 一 一 

有 一 OO 1 rzr 1 一 Oo 1 > 


By equation (19) of Section 1.1, the limit above establishes (12). 
When |r| > 1 the sequence {r2+]j does not converge， Hence the sequence {Snj 
in (14) does not tend to a limit, Therefore, (13) is established. @ 


Equation (12) in Theorem 1.14 Tepresents an effcient way to convert an infinite 
repeating decimal into a fraction. 





卫 xampjle 1.11. 
__ ooe Oo 
03= >》'3(I0)“ 上 = 3+ >》 3(10)“ 
X 一 上 K 一 0 
3 1I0 1 
一 3 一 -一 一 一 
十 T 工 3 了 3 国 


Binary Fractions 


Binary (base 2) fractions can be expressed as sums involving negative powers of 2. 于 
R is a real number that lies in the range 0 < 及 < 1, there exist digits di ，d2，. 
d，... So that 


四 


(16) R=(dx20D+(2x2 7 十 十 (dx2 十.…， 


Where di < {0, 1 We usually express the quantity on the right side of (16) in the 
binary fraction notation 


(17) 尽 一 0.did 四 wo. 
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There are many real numbers whose binary representation requires infinitely many 
digits, The fraction 7/10 can be expressed as 0.7 in base 10, yet its base 2 Tepresenta- 
tion requires infinitely many digits: 


7 
(18) 让 = 0.10110two. 


The binary fraction in (18) is a repeating fraction where the group of four digits 0110 
is repeated forever. 

An efficient algorithm for finding base 2 representations can now be developed. 开 
both sides of (16) are multiplied by 2, the result is 
(19) 2R=d+(@x2 十 十 (加 x2 31) 十 …)， 


The quantity in parentheses on the right side of (19) is a positive number and is less 
than 1. Therefore di is the integer part of 2R, denoted di = int (2R). To continue the 
Process, take the fractional part of (19) and write 


(20) 瑰 =frac(C2R) 一 (d x2 0D+… 十 (四 xx2 01 十 ， 


where frac(2R) is the fractional part of the real number 2R，Multiplication of both 
Sides of (20) by 2 results in 


(21) 2 下 一 史上 二 (全 x2 0 十 .十 ( 几 x2 02 十. 


Now take the integer part of (21) and obtain d2 = int(2 局 ). 
The process is continued, possibly ad infinitum (if 尺 has an infinite nonrepeating 
base 2 representation), and two Sequences [dk and { 丈 ] are recursively generated: 


坟 =int(2 丈 1， 
下 一 frac(2 玫 1)， 


where dl = int(2R) and P 三 frac(2 尺 ). The binary decimal representation of 尺 
then given by the convergent geometric series 


oo 四 
R=》 dji(2) 了 
=1 


(22) 


Example 1.12. The binary decimal representation of 7/10 given in (18) was found using 
the formulas in (22). Let 及 = 7/10 = 0.7; then 


2 尺 三 1.4 di 三 int(1.4) 三 1 歼 = frac(1.4) 一 0.4 
2 下 三 0.8 dd 一 int(0.8) 一 0 到 = ffac(0.8) 一 0.8 
2 刀 =1.6 cd3 三 int(1.6) = 1 到 = frac(1.6) 王 0.6 
2853 三 12 届 4 三 int(.2) 三 1 4 = frac(1.2) 一 0.2 
2 了 4 =0.4 d5 一 int(0.4) = 一 0 785 = frac(0.4) 一 0.4 
285 一 0.8 4 三 int(0.8) 一 0 56 = frac(0.8) 一 0.8 


276 一 1.0 吃 =int(1.60) 一 工 瑟 =frac(1.6) 一 0.6 
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Note that 2 严 = 1.6 王 26. The patterns Kr = dir4 and 奈 = 三友 +4 willoccurfor 大 一 2， 
3, 4,.... Thus 7/10 = 0.10110wo. 四 


Geometric series can be used to find the base 10 rational number that a binary 
number represents. 


Example 1.13. Find the base 10 rational number that the binary number 0.0liwo repre- 
sents, In expanded form， 


0.0lwe=(0x20D++(x23 人 +(0x23 上 +(Ex2 4) 十 …: 


一 yo 人 ?= 1+y oO 2 
类 一 1 天 一 0 


1 144_1 。 
= 了 一 了 





Binary Shifting 
Iarational number that is equivalent to an infinite repeating binary expansion is to be 
found, then a shift in the digits can be helpful, For example, let 9 be given by 


(23) S = 0.0000011000wo， 


Multipiying both sides of (23) by 25 win shift the binary point five places to the right， 
and 32S has the form 


(24) 3243 = 0.11000two. 


Similarly, multiplying both sides of (23) by 210 will shift the binary point ten places to 
tbhe right and 1024 has the form 


(29) 10244 一 11000.11000two， 


The result of naively taking the differences between the left- and right-hand sides of 
(24) and (29) is 9924 王 11000twe or 99248 三 24, since 11000wo。 = 24. Therefore， 
3 一 8/33， 


Scientific Notation 


A standard way to present a Teal number called sciemiifie notufion， is obtained by 
shifting the decimal point and supplying an appropriate power of 10. For example， 


0.0000747 = 7.47 x 10 ”， 
31.41S9263 = 3.141S926S x 10， 
9,700,000,000 = 9.7 x 10?. 
In chemistry, an important constant is Avogadrox number which is 6.02252 x 1023. If 


is the number of atoms in the gram atomic weight of an element. In computer science， 
1 天 一 1.024 x 103. 
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Table 13 ”Decimal Equivalents for a Set of Binary Numbers with 4-Bit Mantissa and 
Exponent of 7 一 3，2,...，3,4 






Exponent: 






Mantissa 


0.1000two 
0.1001two 
0.1010two 
0.101 ltwo 















0.0625 0.125 
0.0703125 | 0.140625 | 0.28125 0.5625 
0.078125 0.156254 | 0.3125 0.625 

0.0859375 | 0.171875 | 0.34375 0.6875 


0.25 










0.1100two | 0.09375 0.1875 0.375 0.75 
0.1101ltwo | 0.1015S625 | 0.203125 | 0.40625 0.8125 
0.1110two | 0.109375 0.21875 0.4375 0.875 












0.1111ltwo | 0.1171875 | 0.234375 | 0.46875 














Machine Numbers 


Compnuters use a normalized foating-point binary representation for real numbers. 
This means that the mathematical quantity x is not actually stored in the computer 
Instead, the computer stores a binary approximation to x: 


(20) X 必 十 gxX 272. 


The numberg is thc marziissa andit is a fnite binary expression satisfying the inequal- 
ity 1/2 < 9 < 1. The integerm is called the expomemt 

Inacomputer only asmall subset of the real number system is used. Typically, this 
Subset contains only a portion of the binary numbers suggested by (26). The number 
of binary digits is restricted in both the numbers dg and 7. For example, consider the 
set of all positive real numbers of the form 


(27) 0.dIdd3ddiwo 义 27， 


where dl 三 1 and 四, and dd are either0 or l,andmn ef 3，2，1,0,12,3， 4}. 
There are eight choices forthe mantissa and eight choices for the exponentin (27), and 
this produces a set of 64 numbers: 


(28) (0.1000we x 2 3 0.100liwe x 2 3,... ,0.1110wo x 24,0.111lwo x 24]， 


The decimal forms of these 64 numbers are given in Table 1.3. It is important to learn 
that when the mantissa and exponent in (27) are restricted the computer has a limited 
number of values it chooses from to store as an approximation to the real number x. 

What would happen if a computer had only a 4-bit mantissa and was restricted 
to perform the computation (二 十 号 十 Assume that the computer rounds all real 
numbers to the closest binary number in Table 1.3, At each step the reader can look at 
the table to see that the best approximation is being used， 


rr 
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A 0.110lwox23 0.0110lwo x2 
六 0.110lwox2 2 = 0.1l0liw x2 12 
0.0011lwo x2 2. 


(29) 


The computer must decide how to store the number 0.00111ws。x 2 2. Assume that 让 
is rounded to 0.1010w。x 2 1. The next Step ls 
As 0.1010wo x2 1 = 0.1010w。 x2 1 
2 0.101lwex2 2 = 0.010llx21 
0.1111lwo。x2 1 


G0) 


The computer must decide how to store the number 0.1111lwo x2 1. Since Tounding 
is assumed to take place, it stores 0.10000two x 20. Therefore, the computer's solution 
to the addition problem is 


7 
(31) 瑟 衬 0.10000wox 20. 
The error in the computer's calculation is 
7 
(32) 五 0.10000twe 宕 0.466667 ”0.500000 盖 0.033333. 


Expressed as a percentage of 7/1S, this amounts to 7.1492. 


Computer Accuracy 


To store numbers accurately computers must have hoating-point binary numbers with 
at least 24 binary bits used for the mantissa; this translates to about seven decimal 
places. 于 a 32-bit mantissa js used, numbers with nine decimal places can be stored. 
Now, again, consider the difficulty encountered in (1) at the beginning of the section， 
when a computer added 1/110 repeatedly. 

Suppose that the mantissa qd in (26) contains 32 binary bits. The condition 1/2 < 9 
implies that the first digit js dl = 1. Hence g has the form 


When fractions are represented in binary form, it is often the case that infinitely 
Imany digits are required. An example is 


1 


(034) 而 


三 0.00011lwo. 
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When the 32-bit mantissa ls used, truncation Ooccurs and the computer uses the internal 
approximation 


(35) 也 冬 0.11001100110011001100110011001100two x2 3， 


The error in the approximation in (3S), the difference between (34) and (3S) is 
(36) 0.1100wo x 2 353 s 2.328306437 x 10 11. 


Because of (36), the compnuter mnust be in error when it sums the 100,000 addends 
of 1/10 in (DThe error must be greater than (100,000)(2.328306437 x 10 10 = 
2.328306437 x 10 56. Indeed, there is a much larger error Occasionally, the Partial 
Sum coujd be rounded up or down. Also, as the Sum grows, the latter addends of 1/10 
are Small compared to-the current Size of the sum, and their contribution is truncated 
more severely，The compounding effect of these errofs actually produced the etrror 
10,000 ”9999.99447 = 5.S3 x 10 3， 


Computer Floating-point Numbers 


Compnuters have both an itegerzode and aioatizg-poizimiode forrepresenting num- 
bers. The integer mode is used for performing calculations that are known to be integer 
valued and has limited usage for numerical analysis. Floating-point numbers are used 
for scientific and engineering applications， It must be understood that any computer 
implementation of equation (26) places restrictions on the number of digits used in the 
mantissa dg, and that the range of possible exponeants 7 mast be limited. 

Compnuters that use 32 bits to represent single-precision real numbers use 8 bits 
for the exponent and 24 bits for the mantissa，They can represent real numbers with 
magnitudes in the range 


2.938736E 39 to 1.701412 十 38 


(ie.,2 128 to 2127) with six decimal digits of numerical precision (e.g., 2 2 = 1.2 x 
10 7). 

Computers that use 48 bits to represent single-precision real numbers might use 
8 bits for the exponent and 40 bits for the mantissa. They can represent teal numbers 
in the ranige 


2.9387358771E 39 to 1.7014118346 互 十 38 


(ie.,2 !2to2127) with 11 decimal digits of numerical precision (e.g.,2 39 一 18x 
10 蕊 ). 


Ithe computer has 64-bit double-precision real numbers, it might use 11 bits for 
the exponent and 53 bits for the mantissa, They can represent real numbers in the range 


5.5602684646268003 下 309 to 8.988465674311580 瑟 十 307 


(Ge.,2 104 to 21023) with about 16 decimal digits of numerical precision (e.g.,2 2 一 
2.2 x 10 19). 


去 
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卫 xercises for Binary Numbers 





iP 


I0. 


II 


12， 


。Use a computer to accumujlate the following sums. The intent is to have the computer 


do repeated Subtractions, Do not use the multiplication shortcut. 

(人 10.000 和 IO00. (bj) 10.000 ”并 800000.125 

USe equations (4) and (3) to convert the following binary numbers to _ decimal 
人 (base 10) form. 

(a) 1010ltwo (b) 111000two 

(c) 11111110wo (100000011lwo 


。Use equations (16) and (17) to convert the following binary fractions to decimal 


(base 10) form. 
(a) 0.1101lHwo (b) 0.10101wao 
(c) 0.101010lwo (dj) 0.110110110wo 


。Convert the following binary numbers to decimal (base 10) form. 


(al) 10110101ltwo (b) 11.001001000ltwo 


。The numbers in Exercise 4 are approximately V2 and ，Find the error in these 


approximations, that is, find 
(a) wvV2 1.011010lwo。 (Use V2 = 1.41421356237309...) 
(p) 六 11.001001000lw。 (User = 3.141$9265358979...) 


、Follow Exampile 1.10 and convert the following to binary numbpers. 


(a) 23 (p) 87 (CO 378 () 2388 


。Follow Example 1.12 and convert the following to a binary fraction of the form 


0.did2 …. antwo-. 


(a) 7/16 (pb) 13/116 (cC) 23132 (d) 73/128 
，Follow Example 1.12 and convert the following to an infinite repeating binary frac- 

tion . 

(a) 1710 (bj 1/3 (ce) 177 


。For the following seven-digit binary apProximations, fnd the error in the approxima- 


tion RR 0.did2dad4d5d6d7two. 

(a) 1110 盖 0.0001100wo (b) 177 0 

Show that the binary expansion 1/7 = 0.00lwo is equivalentt to 了 一 站 十 吉 十 示 十 
.Use Theorem 1.14 to establish this expansion. 

SoY that the binary expansion 1/5 = 0.001lHwo is equivalent to 革 3 一 芒 十 疡 十 

5 十 …… Use Theorem 1.14 to establish this expansion， 

Prove that any number 2 ,where N is a positive integer, can be represented as a 


decimal number that has N digits, that is, 2 = 0.dldd3 .…dw. Bint 17/2 = 0.5， 
1/4 = 0.25,.... 
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13. Use Table 1.3 to determine what happens when a _ computer with a 4-bit mantissa 
performs the following calculations. 


(二 十 贡 十 和 中 ( 方 + 扫 二 
@ (证 + 抽 + (GD (让 + 夫 十 
14. Show that when 2 is replaced by 3 in all the formulas in (8) the result is a method for 


finding the base 3 expansion of a positive integer Express the following integers in 
base 3， 


(a) 10 (b) 23 (cj) 421 (四 1784 
1S。Show that when 2 is replaced by 3 in (22) the result is a method for fnding the base 3 


expansion of a positive number 尺 that lies in the interval 0 < 只 < 1. Express the 
following numbers in base 3. 


(aj) 173 (b) 1/2 (cj 1/10 ( 思 ) 11/27 
Show that when 2 is replaced by $ in all the formulas in (8) the result is a maethod for 


finding the base $ expansion of a positive integer. 也 Xpress the following integers ip 
base 和 . 


(a) 10 (b) 35 (c) 721 (d) 734 
17. Show that when 2 is replacedby S in (22) the result is a method for finding the base 


expansion of a positive number 尺 that lies in the interval 0 < 及 < 1.， Express the 
following numbers in base $， 


(a) 1/3 (bj) 1/2 (cj .1710 ()，154/625 


16 


Error Analysis 


In the practice ofnumerical analysis it is important to be aware that computed solutions 
are not exact mathematical solutions，The precision of a numerical solution can be 
diminished in severaj subtle ways. Understanding these difficulties can often guide the 
practitioner in the proper implementation and/or development of numerical algorithms， 


Definition 1.7， Suppose that Pis an approximation to PThe psofuute error is 
Ep 一 |P 下 ,andtherelotpye erroris Rp 一 |P 了 局 /pl,providedthat 六 头 0 作 


The error is Simply the difference between the true value and the approximate 
Value, whereas the rejative error is a portion of the true value. 


Example 1.14. Find the error and relative error in the following three cases. Letxy 一 
3.141592 and 区 = 3.14; then the error is 


(1a) 一 |x 2J%=13.141$92 3.14| = 0.001592， 
and the relative error is 


lz 习 0.001592 
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Let y = 1,000,000 and 分 = 999,996; then the error is 
(1b) 下 一 > 习 = 11,000,000 ”999, 996| = 4， 


and the relative error is 





Let z = 0.000012 andZ 之 = 0.000009, then the error is 
(1o) 已 =jz 下 = 10.000012 0.000009| = 0.000003， 


and the relative error is 


lz 于 0.000003 
lzl| ”0.000012 





Rz 一 0.25. @ 
In case (la), there is not too much difference between Ex and RR ,and either could 
be used to determine the accuracy ofX. In case (lb),the value of y is of magnitude 106， 
the error 素 y is large, and the relative error Ry is small. In this case, 分 would probably 
be considered a good approximation to y， In case (lcj, z is of magnitude 10 5 and 
the error Ex js the smallest of all three cases, but the relative error Rz is the largest. 
In terms of percentage, it amounts to 25%, and thus2 is a bad approximation to z. 
Observe that as | 了 | moyes away from 1 (greater than or less than) the relative error Rp 
is a better indicator of the accuracy of the approximation than 无 p，Relative error is 
Preferred for fioating-point representations since it deals directly with the mantissa. 


Definition 1.8， The number 六 is said to approximate p to d significant digits ifd is 
the largest positive integer for which 


10 4 
(2) 忆 有 刀 < 一 一 . 
| 局 | 2 


Example 1.1S， Determine the number of significant digits for the approximations in 
Example 1.14. 


(3a) Ix = 3.141592 and 区 = 3.14, then lx 2/*| = 0.000507 < 10 2/2. Therefore， 
和 approximates x to two significant digits. ， 


(3b) 开 》 = 1000,000 andy = 999,996, then ly 3/y| = 0.000004 < 10 5/2. 
Therefore, 仿 approximates 》 to five significant digits. 


(3c) 开 z = 0.000012 and 人 = 0.000009,then lz 习 /|z| = 0.25 < 10 5/2. Therefore, 信 
approximates z to no significant digits. 国 
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Figure 1.7 ”The graphs of 》 一 


xc = ex， y= 记 (xz), and the area 
under the curve for 0 <x< 世 





Truncation Error 


The notion of truncation error Usually refers to errors introduced when a more com- 
plicated mathematical expression 1s“replaced”with a more elementary formula. This 
terminology originates from the technique of replacing a complicated function with a 
truncated Taylor series. For example, the infinite Taylor series 


1 
加 2 3 4 7 
Imight be replaced with just the first five terms 1 十 zx 十 条 十 世 后 . This might be 
done when approximating an integral numerically. 


Example 1.16。 Given that 月 /er dx = 0.544987104184 = P， determine the accuracy 


of the approximation obtained by Teplac ng ， the integrand Fo) 一 6@x ”with the truncated 
4 
Taylor series PCx) 一 1 上 +X2 十 七 下 十 支 始 页 。 
Term-by-term integration produces 


1/2 4 X6 3 5 区 9 AL 
1 一 二 二 十 二 | ax = -十 二 十 二 十 二 
人 7 _ 


1 1 1 上 1 上 1 1 

2 24 320 5376 110, 592 
2,.109,491 一 

= 二 -一 一 一 0. 72 一介 
870720 0.544986720817 一 方 


Since10 5/2 > |p 人 羽 /lp| = 7.03442x10 7 > 10 6/2,theapproximation 广 agrees with 
the true answer D = 0.544987104184 to five significant digits. The graphs of f(x) 二 ez 
andy 一 Ps(x) and the area underthe curvefor0 <x < 1/2 are shown in Figure 1.7， 上 晶 
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和 Round-OfF Error 


A compnuter's fepresentation of real numbers is limited to the fixed precision of the 
Imantissa，True values are Sometimes not Stored exactly by a computer's represen- 
tation， This is called roxzrzd-ofr eryror， In the preceding section the real number 
17/10 = 0.00011ltwo was truncated when it was Stored in a computer. The actual num- 
ber that is Stored in the computer may Undergo chopping or rounding of the last digit. 
Therefore, since the computer hardware works with only a limited number of digits in 
machine numbers, rounding errors are introduced and propagated in Successive com- 
Putations， 





Chopping off Versus Rounding O 任 
Consider any real number DP that is expressed in a 7zOr72alized deczzmacl Jprrz: 
(4) 忆 王 十 0.diad2d3 .中 Qk+1. .xx 10"， 


wherel1<dl<9and0<diji<9forj) > 1.SupposethatK is the maximum number 
of decimal digits carried in the floating-point computations of a compnuter; then the real 
number P is Tepresented by .六 cnop(P), which is given by 


(5) jlenop(p) = 士 0.didzd. 罗 x 10， 


wherel1<d<9and0<di<9forl< /<K Thenumber J chop(P) is called 
the cjpopped .oatzrzzg-poiat represeitatior of P. In this case the kth digit of 产 chop(P) 
agrees with the kth digit of pP， An alternative K-digit representation is the roraded 
Joatzzpg-poipt represemiatiomr Fna(P), which js given by 


(0) Jound(CD) = 士 0.dqid2d3 ..F X 10”， 
where ld 中 <9and0< 太 和 9forl< 7 < 大 andthelastdigit ,is obtained 


by rounding the number dkdk+1dk+2 to the nearest integer For example, the real 
number 


22 
疡 三 了 二 3.142857142837142857 . . . 
has the following six-digit representations: 


Jichop(P) = 0.314285 x 10)， 
lounda(P) = 0.314286 x 101， 
For common Purposes the chopping and rounding would be written as 3.14285 and 


.3.14286, respectively. The reader should note that essentially all compnuters use some 
form of the rounded hoating-point representation method. 
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Loss of Significance 


Consider the two numbers P = 3.141S926336 and g = 3.14139S7341, which are 
nearly equal and both carry 11 decimal digits of precision， Suppose that their differ- 
ence js formed: P 9 = 0.0000030805. Since the first six digits of P and 9 are 
the same, their difference PP 。 d contains only five decimal digits of precision. This 
phenomenon is called 1oss of sigmiicarce or Stactiye cotceticfhior. This reduction 
in the precision of the final computed answer can creep in when it is not Suspected. 


了 Example 1.17， Compare the results of calculating (900) and 8(300) using six digits 
。 。 几 稚 六 

and rounding,. Tbhe functions are jx) 一 X VX 十 1 VX) and 8S(x) 一 TEA For the 

first function ,， 


7(500) 一 500 (v50i v500) 
二 500(22.3830 “22.3607) 二 500(0.0223) 一 11.1500. 


For 8(x)， 


500 
(G500)= -一 > 
8 VD V50 
S00 S00 


”22.3830 十 22.3607 ”44.7437 





一 11.1748， 


The second function, g(x), is algebraically equivalent to 六 (xz), as shown by the compnuta- 
tion 


xz Vz+I vX) vr 二 I++VH) 
wx 十 1 十 NT 
xf( X 二 了 ) v7 
wVX 十 TI 十 VE 
”Vi NA 


The answer, 8(500) = 11.1748, involves less error and is the same as that obtained by 
rounding the true answer 11.174755300747198 . ,. to six digits. 国 


Jr) = 


The reader js encouraged to study Exercise 12 on how to avoid loss of significance 
in the quadratic formula. The next example shows that a truncated Taylor series will 
Sometimes help avoid the loss of significance error, 


了 上 xample 1.18， Compare the results of calculating j(0.01) and 已 (0.01) using six digits 
and rounding, where 


ex 1] 区 1 克 2 
J60 = 一 二 一 and PG)= 了 +E+ 均 . 
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The function P(x) is the Taylor polynomial of degree 7 = 2 for Frx) expanded about 
X 一 0. 
For the first function 


eol 1 001 1010030 1 001 





For the second function 


1 0.01 0.001 
已 (0.01) 一 7 十 本 十 一 
= 0.5 十 0.001667 十 0.000004 = 0.501671. 


The answer P(0.01) = 0.501671 contajns less error and is the same as that obtained by 
rounding the true answer 0.30167084168057S42 ... to Six digits， ] 


For polynomial evaluation, the rearrangement of terms into nested multiplication form 
will sometimes produce a better result. 


Example 1.19。 Let PO) = xz 3x?+3xr landCo = (CC 3r+3)xr 1 
Use three-dqigit rounding arithmetic to compute approximations to _P(2.19) and O(2.19). 
Compare them with the true values, P(2.19) = C(2.19) = 1.68$159. 


P(2.19) x% (2.19)3 3C.19)2+3(C2.19) 1 
= 10.5 14.4+6.57 1 = 1.67. 
@0C.19) 、 ((2.19 3)2.19 十 3)2.19 1 = 1.69. 


The errors are 0.015159 and ”0.004841, respectively. Thus the approximation CO(2.19) 
1.69 has less error Exercise 6 explores the situation near the root of this polynomial， 四 


OP ) Order of Approximation 
Oo oo 
Clearly the sequences | 吉 and 全 | are both converging to zero. In addition, 让 
天 一 ， 用 一 
should be observed that the first sequence is converging to zero more rapidly than the 
second sequence. In the coming chapters some special terminology and notation will 
be used to describe how rapidly a sequence is converging. 


Definition 1.9. The function Ap) is said to be 0i8 OH of g(P)， denoted Fi) 三 
O(g(P)), 这 there exist constants C and c such that 


(7) 1FODF< CI whenever 严 <C. 全 


Example 1.20. Consider the functions fG) = x2+1landg(xr) 一 x3. Sincex2 <x3and 
1<xforx>Ditfolowsthatxz2 二 1<2x3forxz> 1.Therefore, fo = OUgCD))， 
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The big Oh notation provides auseful way of describing the rate of growth of a fanction 
in terms of well-known elementary functions (xm La， ax， log。x, etc.)， 
The rate of convergence of sequences can be described in a similar manner, 


Definition 1.10. Let [zzj 季 1 and [入 ] 沁 be two sequences. The sequence {zzj is 
said to be of order big Oh of {y}，denoted xn = OO, 让 there exist constants C 
and N such that 


(3) lx < Clyn| whenever . 二 N. 办 
五 je1.21， 王 工 = 0 人 (1),since 到 < 二 一 工 whenever. 二 1 国 
X3I0DPDIe .二 上， 3 一 元 六 一 > 1. 


Often a function 太 (P) is approximated by a function P(P) and the error bound is 
known to be MI| 瑚 |. This leads to the following defhinition. 


Definition 1.11. Assume that (OPp) is approximated by the function p(P) and that 
there exist a Teal constant M > 0 and a positive integer m So that 


ID PuoDl _ 


9 
(9) 页， < 


M for sufficiently small 及 . 


We say that P(P) approximates (PP) with order of approximation O(P) and write 
(10) (OP) 一 POP) 十 DC)， 全 


When relation (9) ls rewritten in the form | ji PE< | 人 |， we see thatthe 
notation O(P) stands in place of the error bound MI The following results show 
how to apply the definition to simple combinations of two functions， 


Theorem 1.1S. Assume that FP) = P( 十 OO) 8 一 9) 十 OO and 
六 一 min{m, 1 Then 


(1D) ja)TS8OD) =PODT9q(D 二 OO )， 
〈12) js = Pda(D 十 OO)， 
and 
jD PCD . 
13 一 一 一 一 一 7 . 
(13) 5 一 了 十 OO ) provided that 8S() 天 0 and qg() 关 0 


t is instructive to consider P(xY) to be the zth Taylor polynomial approximation 
of Fo); then the remainder term is Simply designated O(p2+i), which stands for the 
presence of omitted terms starting with the power pz+l. The remainder term Converges 
to zero with the same rapidity that P"+1i ConveIges to zero as / approaches zero,， as 
expressed in the relationship 


Cr+rD(a) 
14 O Pa+1 儿 AP2+1 入 了 天 十 1 
0)  ) (十 1! 
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for suffciently small ，Hence the notation O(p2+D stands in place of the quantity 
MHz+l, where M is a constant or “behaves like a constant,” 


Theorem 1.16 (Taylors Theorem). Assume that 太 e C2+lfa,b. 玉 both xo and 
X 一 2X0 十 瑚 liein[a,p,then 


加 RFOCxo) n+1 
(15) Jeo+ 记 = 记 一 有 十 Onn+D1). 


The following example ustrates the above theorems. The computations use the 
addition properties 人 OO + OO = OO ti OP) 二 O(03) = OO0， 
wherer = min{p, gj, and the multiplicative property (in) OP)O(9) 一 DO(1)， 
wherey 一 疡 十 9. . 


卫 xample 1.22.。 Consider the Taylor polynomial expansions 


2 4 


灵 严 
中 = 1+H+ 二 和 二 00 and cos( 门 =1] 均 十 页 十 OUe 


Determine the order approximation for their Sum and broduct. 
Forthe sum we have 


2 84 6 
亢 十 下 十 OU9 


玫 3 
人 十 cos(P) 一 1 工 十 声 十 宙 + 生 +000+i 本 


24 


ja 
一 2+ 包 十 可 + 00) + 所 -0O09) 


Since OU 十 下 = OU4) and OO 十 OU6) = oo this reduces to 
有 
近 十 cos( 人 一 2 二 十 可 十 OO 


and the order of approximation is O(p4). 
The productis treated 四 


ep cos(j) 一 ( 十 天 + 一 -+ 一 1 0 (和 所 + + 生 +o09 


j2 83 
一 1+A 十 万 十 可 1 所 + 全 


了 2 6 1 4 
+ 和 + 全 ooo+( 歹 十 而 OP ) 


+ 0O04)006) 

电 和 和 
3 24 24 48 144 
+O00 + OO4) + DO06). 


一 虐 十 尹 
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Since 0O(4)O(p6) = Oil0) and 
5p4 15 Rh 1 
~ 76 及 4 及 10 一 0 84 ， 
4 志 十 朴 二 二 十 2 )+O TO ) (PP ) 


the preceding equation is Simplified to yield 
83 
ep cos(P) 一 上 十 天 本 + 0O0)， 


and the order of approximation is O(p4)， 可 


Order of Convergence of a Sequence 


Numerical approximations are often arrived at by computing a sequence of approxi- 
Imations that get closer and closer to the desired answer The definition of big Oh for 
Sequences Was given in Definition 1.10, and the definition of order of convergence for 
a Sequence is analogous to that given for functions in Definition 1.11. 


Definition 1.12， Suppose that limn->ooxn = X and {mm]2s21 is a sequence with 
limo~>comm = 0、We Say that {fxnj?，converges to xx With the order of conver- 


gence O(rm), 寺 there exists a constant 天 > 0 such that 


[xz 2 


厅 < 开 for 7 suffticiently large. 
-|m 


This is indicated by writing xi = x 十 Oorzr 一 With order of conver- 
gence O (mh)， 全 


Example 1.23. Let xn = cos(a)/22 and mm = 172: then lim coxn 一 0with arate of 
convergence O(1/7122). This follows immediately from the relation 
|cos(D/P2| 
一 -一 一 一 一 一 一 | cos <1 for all 7 
[7 |cosC9)| < 天 四 


Propagation of 了 rror 


Let us investigate how error might be propagated in successive compnutations. Consider 
the addition of two numbers P and 9g (the tmue values) with the approximate values 方 
and 9，which contain errors ep and eq, respectively，Starting with P 一 方 + ep and 
4 一 分 十 er,the sumiis 


(10) 忆 二 4 三 ( 甩 +ep) 十 人 十 cg) = (万 十 们 十 (ep 十 6). 


Hence, for addition, the error in the sum is the Sum of the errors in the addends. 
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The propagation of error in multiplication is more complicated. The product is 
(17) P9 一 ( 广 +ep)( 方 +eg) = 了 十 恋 十 Gep 十 epeg， 


Hence, 这 疡 and9 arelargerthan 1l in absolute value,terms Fey andGep showthatthere 
is a possibility of magnification of the original errors ep and cy. Insights are gained 让 
we look at the relative error Rearrange the termas in (17) to get 


(18) pqg 9= Fes 二 aep 二 epeg， 


Suppose that 忆 夭 0andd 头 0;then wecan divide (18) by pa to obtain the relative 
error in the product pa: 


_ 2 2 _ 8 二 gep+eped _ pee ,Seo <p6d 


(19) Roy 
Pd Pd pq pe pa 


Furthermore，suppose that 方 and 人 are good approximations for P and 9; then 
Pj/ps191/4s1andRpRe = (ep/p)(eo/g) 闪 0(Rn and Roy aretherelative errors 
in the approximations 六 and 9). Then making these substitutions into (19) yields the 
Simplified relationship 


Pa 7 cq ，6EP 
(20) _ 民 RD 三 一 一 名 一 十 一 二 0 一 R 十 R. 
Pd pa 9 万 好 已 


This shows that the relative error in the product pa is approximately the sum of the 
relative errors in the approximations 方 and 信 . 

Often an initial error will be propagated in a sequence of calculations. A quality 
that is desirable for any numerical process is that a small error in the initial conditions 
wil produce small changes in the final result, An algorithm with this feature is called 
Sixbje; otherwise, it is called xzastajpie，Whenever possible we shall choose methods 
that are stable, The following definition is used to describe the propagation of error. 


Definition 1.13. Suppose that e represents an initial error and ec(z) represents the 
growth of the error after m steps. 于 |e(0O| sne,the growth of error is said to be linear 
开 |e(a)l 之 天 "e, the growth of error is called exponential. If K > 1 the exponential 
error grows without bound as 7 一 oo, and 证 0 < 天 < 1, the exponential error 
diminishes to zero as 7 一 oo, ， 人 


The next two examples Show how an initial error can propagate in either a stable 
or an unstable fashion，In the first example, three algorithms are introduced，Each 
algorithm recursively generates the same Sequence. Then, in the second example, small 
changes will be made to the initial conditions and the propagation of error will be 
analyzed. 
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Table 1.4 The Sequence {xn] = {1732] and the Approximations {rn} {pn] and {qv} 







7 






































1 0.9999600000 1.0000000000 1.0000000000 

1 了 一 0.3333333333 0.3333200000 0.3333200000 0.3333200000 
2 加 =0.1111111111 0.1111066667 0.1110933330 0.1110666667 
3 力 一 0.0370370370 0.0370355556 0.0370177778 0.0369022222 
4 赴 一 0.0123450790 0.0123451852 0.01232592539 0.0119407407 
5 市 一 0.0041132263 0.00411S0617 0.0040953086 0.0029002469 
6 遍 一 0.0013717421 0.0013716872 0.0013517695 0.0022732510 
7 7 三 0.0004572474 0.0004572291 0.0004372565 0.0104777503 
8 二 [ 二 0.0001S$24158 0.0001524097 0.0001324188 0.0320525834 
9 5 三 0.0000508053 0.0000508032 0.0000308063 0.0983641945 
10 有 5 一 0.0000169351 0.0000169344 0.0000030646 0.2952280648 





Example 1.24， Show that the following three schemes can be used with infinite-precision 


arithmetic to Tecursively generate the terms in the sequence {1/ 3”]220. 


(2l1a) ro=1 and 户 一 了 证 1 forz = 1 2， .， 
1 4 1 
(21b) P0 一 上 Pi=3， and 有 mn 二 了 Po 1 了 PP 2 form 三 2,3,...， 
1 10 
(21c) 9qo=1,91 = 了 3 and 血 二 本 和 1 Gd 2 for7 一 2,3,..,， 


Formula (21a) is obvious. In (21b) the difference equation has the general solution py 一 
A4(1/3”) 十 姻 .This can be verified by direct substitution: 


4 1 _4(4 1(4 ， 
3 3 2 一 3 和 了 区 荆 十 
4 3 

-人 ( 仿 六 )4 


Setting 4 = 1 and 也 = 0 will generate the desired sequence，In (21c) the difference 
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Tablel1.sS The Error Sequences [fxn 









































忆 刘 0 了 宁 了 mw 一 定 | 





0.0000400000 
0.0000133333 
0.0000044444 
0.0000014815 
0.0000004938 
0.0000001646 
0.0000000549 
0.0000000183 
0.0000000061 
0.0000000020 
0.0000000007 


rm ,fen 





0.0000000000 
0.0000133333 
0.0000177778 
0.0000192593 
0.0000197531 
0.0000199177 
0.0000199726 
0.0000199909 
0.0000199970 
0.0000199990 
0.0000199997 





Pr and (xn 





0.0000000000 
0.0000013333 
0.0000444444 
0.0001348148 
0.0004049383 
0.0012149794 
0.0036449931 
0.0109349977 
0.0328049992 
0.0984149998 
0.2952449999 


equation has the general solution gr = 4(1/37) 十 吾 32. This too is verified by substitution': 





10 10 1 .4 凡 
本 9 1 9n := 和 (和 洁 +a )) (; 本 十 吾 3 ?) 
10 9 2 
一 人 到) 4 (10 13 “有 
1 天 
一 4 了 十 九 3 一 2 
Setting 4=1and 刀 =0generates the tequired Sequence， 国 
Example 1.2S， Generate approximations to the sequence {xnr) = {1/37} using the 
Schemes 
1 
(22a) 10 一 0.99996 and m 一 了 六 1 for =1 2 ...， 
4 1 
(22b) po =1 pl 一 0.33332， and Pm 一 了 Pr 1 了 Pr 2 for7 一 2,，3，...， 
10 
(22c) d0=1,91 一 0.33332， and 9qn 一 本 和 1 Ggn 2 for ]]/. 一 2，3，. .，,. 


In (22a) the initial error in ro is 0.00004, and in (22b) and (22c) the initial errors in P1 
and dgl are 0.000013. Investigate the propagation of error for each scheme. 

Table 1.4 gives the first ten numerical approximations for each sequence, and Table 1.5 
gives the error in each formula. The error for {mm] is stable and decreases in an exponential 
manner The error for {pnj is stable. The error for {anj is unstable and grows at an expo- 
nential rate，Although the error for { Pr] is stable, the terms pn 一 0 as7 一 ceo, so that 
the erroreventually dominates and the terms past pg have no significant digits. Figures 1.8， 
1.9, and 1.10 show the errors in {rm},{Pnj, and {qgn]j, respectively. 国 
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0.000015 
0.000010 


0.000005S e 


2 4 6 8 10 


Figure 1.8 Astable decreasing error Sequence {xr 六]. 


一 Pn 


0.000020 
0.000015 
0.000010 
0.000005 





2 4 6 8 10 
Figure 1.9 Astable error sequence (2 Pr 


Uncertainty in Data 


Data from real-world problems contain uncertainty or error， This type of error ls re- 
ferred to as noise. It will affect the accuracy of any numerical computation that is based 
on the data. An improvement of precision is not accomplished by performing succes- 
sive computations using noisy data，Hence, if you start with data with d significant 
digits of accuracy, then the result of a computation should be reported in d significant 
digits of accuracy. For example, Suppose that the data P1 = 4.1S2 and P2 = 0.07931 
both have four significant digits of accuracy. Then it is tempting to report all the digits 
that appear on your calculator (ie., P1 十 2 = 4.23131). This is an oversight because 


2 一 9 





2 4 6 8 10 


Eigure 1.10 An unstable increasing error sequence {xr 9dn]， 
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you should not report conclusions from noisy data that have Imore Significant digits 
than the original data. The proper anSwer in this Situation is P1 十 P2 一 4.231. 


EXxercises for Error Analysis 





。Find the error 达 xz and relative efroOT Rx、 Also determine the number of significant 


digits in the approximation. 

(a) xx 一 2.71828182, 和 = 2.7182 
(bp) y=98,350,y= 98,000 

(ce) Zz=0.000068,z = 0.00006 


。Complete the following computation 


l/4 ， 17/4 X2  X6 
“QUx 科 1+x2+ 一 二 一] dx= 人 六 
上 2 ”Gyx 人 人 2 十 可 引 己 


State what type of error is present in this situation，Compare your answer with the 
true value P = 0.23$3074606. 


。(a) ”Consider the data pl = 1.414 and p2 = 0.09125, which have four significant 


digits of accuracy，Determine the Proper answer for the sum Pl1 十 p2 and the 
product P1P2. 

() Consider the data P1 = 31.415 and P2 = 0.027182, which have five significant 
digits of accuracy，Determine the Proper anSswWer for the sum Pi1 十 p2 and the 
product P1P2. 


Complete the following computation and state what type of error is present in this 
situation. 
sin 于 十 0.00001) sin 于) 0.70711385222 ”0.70710678119 


全 0.00001 0.00001 
四 In(2 + 0.00005) ln(2) ”0.69317218025 0.69314718056 
0.00005 本 0.00005 本 


。，Sometimes the loss of significance efror can be avoided by rearranging terms in the 


fanction using a known identity from trigonometry or algebra，Find an equivalent 
formula for the following functions that avoids a loss of significance. 

(a) ln(x 十 1) jn(x)forlargex 

(D) vVx2 十 1 xforlargex 


(@O cos2(z) sin2(x) forx 之 元 /4 


(d) V 一 Se forx 宛 


。Polynomial Evaluation. Let P(x) = xz3 3x2+3x 1,OC)=(G 3)x 十 3)x 1 


and RGz) = (13. 
( Use fourdigitrounding arithmetic and compnute 已 2.72), C(2.72),and R(2.72)， 
in the computation of P(x), assume that (2.72)3 = 20.12 and (2.72)2 = 7.398. 
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(b) Use four-digit rounding arithmetic and compute P(0.97$)，@C(0.97S)，and 
R(0.975)，In the compnutation of 已 (x)，assume that (0.975)3 一 0.9268 and 
(0.975)2 = 0.9506. 


7. Use three-digit rounding arithmetic to compnute the following sums (sum in the given 
ordeT): 


Ga 二 4 去 ， 工 4- 天 
8S. Discuss the propagation of error for the following: 
(a) The sum of three numbers: 


忆 +94+r 一 (万 +ep) 十 G 十 Ge) 十 信 十 6)， 


五 +ep 


(bj The quotient oftwo numbers: 上 -~ 二 。 
Q 十 6 


(c) The product ofthree numbers: 


Por= (+ep)GG+eo) 人 上 +er)， 


9 Given the Taylor polynomial expansions 
1 
方志 =1 十 闫 十 2 十 1 十 OO4) 
and 
12 
cos(P) 一 1 元 十 页 
Determine the order of approximation for their sum and product. 


十 DO(p6). 


10， Given the Jaylor polynomial expansions 


记 要 j4 
记 人 2 5 
e 一 工 十 儿 十 可 十 可 二 页 十 OO ) 
and 
有 3 
sin(j) 一 刀 可 十 O(005). 
Determine the order of approximation for their sum and product. 


11， Given the Taylor polynomial expansions 


有 2 4 6 
cos(P) 一 1 机 十 而 十 OU ) 
and 
j3 7 1 
Sin(j) 一 天 可 十 可 十 Cu ). 


Petermine the order of approximation for their sum and product. 


SEC, 1.3 ”ERROR ANALYSIS 39 


12. Improving the Quadratic Fonnuja，Assumethata 关 0andp2 4ac > 0andconsider 
the equation ax? 二 bx 十 c = 0. Theroots canbe computed with the quadratic formulas 


_ 六 十 Vp2 4ac 已 p2 4ac 
(1 X1 一 一 and X2 一 一 2 


Show that these roots can be calculated with the equivalent formulas 


2c 2c 
i X1 一 一 一 一 一- and 2 三 -一 -一 一 一 . 
名 TV 4ac 已 2 4ac 


硝 nt Rationalize the numerators in (. Remark. In the cases when lb| s Vb2 4ac， 
one must proceed with caution to avoid loss of precision due to a catastrophic can- 
cellation. 入 > 0, then xl should be computed with formula (ii) and xz should be 
compnuted using 人 G). However 这 < 0, then xl Should be compnuted using (D and x2 
should be computed using (ii)， 


13、Use the appropriate formula for xl and x2 mentioned in Exercise 12 to find the roots 
of the following quadratic equations、. 


(a) xz 1000.00lxz+1=0 


大 
(b) x2 10,000.0001r+1=0 
(oO xx2 100,000.00001x 十 1=0 
(四 xz 1000,000.000001xz 十 1=0 


Algorithms and Programs 


[we ee | 


1、Use the results of Exercises 12 and 13 to construct an algorithm and MATLAB pro- 
gram that will accurately compute the roots of a quadratic equation in all situations， 
including the troublesome ones when jp| s VD2 4ac， 

2. Follow Example 1.25 and generate the first ten numerical approximations for each 
of the following three difference equations. In each case a Small initial error is in- 
toduced, 开 there were no initial error then each of the difference equations would 


generate the Sequence {1/2} .Produce output analogousto Tables 1.4 and 1.5 and 
Figures 1.8, 1.9, and 1.10. 


(3) 1 = 0.994andmm 一 二 rr 1， form 一 1 2,... 
(pb) po =1pl=0.497,and pr =3pn 1 mn 2 forn 一 2,3,... 
(oO) 4o=1,41=0.497,andqn =3qn 1 qd 2，forn 一 2,4,..， 





The solution of Nonlinear 
Equations 三 x) = 三 0 


Consider the physical problem that involves a spherical ball of radius r that is Sub- 
Imerged to a depth d in water (see Figure 2.1). Assume that the ball is constructed from 
avariety of longleaf pine that has a density of 0 = 0.638 and that its radius meastres 
六 一 10 cm. How much of the ball will be submerged when it is placed in water? 

The mass Mu of water displaced when a sphere is submerged to a depth d is 


d 2 
Au 三 1/ (Cr (x 门 2) dx 一 玫 忆 人， 
0 


and the mass of the ball is Mb = 4rrr30/3， Applying Archimedes' law M = Mp， 
produces the following equation that must be solved: 

T(d3 3d2r 十 4r30) 

一 一 3 一 一 0 


人 


r= 10 了 Figure 2.1 The portion of a 


Sphere of radius r that is to be sub- 
-人 Imerged to a depth d. 
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y=2552 - 30d2 + d 


2000 





Figure 2.2 ”The cubic y》 = 2552 ”30d2 十 友 . 


In our case (with r = 10 and o = 0.638) this equation becomes 


Fr(2S$2 ”30d2 十 d3) 
3 


The graph of the cubic polynomial y = 2552 ”30d2 + da is shown in Figure 2.2 and 
from it one can see that the Solution lies nearthe value d 一 12. 

The goal of this chapter is to develop a variety of methods for finding numerical 
approximations for the roots of an equation. For example, the bisection method coujld 
be applied to obtain the three roots 中 = ”8.17607212, d = 11.861501S1, and 
da = 26.31457061. The first toot dl is not a feasible solution forthis problem, because 
d cannot be negative, The third root do is larger than the diameter of the sphere and 让 
is not the desired solution. The root 履 = 11.861S01S1l lies in the interval [0, 20] and 
is the proper Solution. Its magnitude is reasonable because a little more than one-half 
of the sphere must be submerged. 


Iteration for Solvingx 一 8(x) 


A fundamental principle in computer Science is iteration，As the name suggests,，a 
Process is repeated until an anSwWer is achieved，Iterative techniques are used to find 
roots of equations, solutions of linear and nonlinear systems of equations, and solutions 
of differential equations. In this section we study the process of iteration using repeated 
Substitution . 

Arale or fanction 8(x) for computing SuccesSsive terms is needed, together with a 
starting value po0. Then a sequence of values {Pkj is obtained using the iterative rule 
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Pk+1 一 8(CPDk) .The sequence has the pattern 


Po (starting value) 
D1 一 8S(p0) 
P2 一 8CP1) 
(D) : 
性 一 8CDK 1) 
Pk+1 一 8S(CP) 


What can we learn from an unending sequence of numbers? If the numbers tend 
to a limit we feel that something has been achieved, But what if the numbers diverge 
or are periodic? The next example addresses this situation. 


了 Exampje 2.1. The iterative rule po = 1] and Pk+1 一 1.001mfor 大 一 0, 1,... produces 
a divergent sequence. The first 100 terms look as follows: 


pl1 = 1.001p0 = (1.001)(1.000000) = 1.001000， 
pa2 = 1.001p1 = (1.000(1.001000) = 1.002001， 
pa = 1.001p? = (1.00D(1.002001) = 1.003003， 


P1o0 = 1.001p9% = (1.001)(1.104012) = 1.105116. 


The process can be continued indefinitely, and it is easily shown that lim， oo pn 三 十 co. 
In Chapter 9 we wil see that the Sequence {pkj is a numerical solution to the differential 
equation y' = 0.001y. The solution is known to be y(xr) = e0001*. Indeed, if we compare 
the 100th term in the Sequence with y(100), we see that p1o0 = 1.10$116 1.10S171 = 
e0.1 = y(100). 四 


In this section We are concerned With the types of functions 8(x) that produce 
CoOnvergent sequences {Pk}. 


Finding Fixed Points 
Definition 2.1 (Fixed Pointbj. AJixed poinzat of a function g(zr) is a real number 己 
such that 尼 = 8(P). 全 


Geometrically, the fixed points of a function y》 = 8(x) are the points of intersection 
of 》 一 8(x) and y 一 x. 


Definition 2.2 (Fixed-point Iteration). The iteration pn+l = 8(pn) form 一 0， 
1 ...jis called jixed-poizt iteratiopz. 入 
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人 Theorem 2.1， Assumethat g is a continuous function and that{pn]220is asequence 
generated by fixed-point iteration. If limn_>oo pn = P,then Pis afixed point of g(x). 


Proof Ilim, >oo pn = P,thenlim_ >oo pn+l 一 忆 . Ifolows from this result the 
continuity of g, and the relation pn+l 三 8(pn) that 


O s(PD -slipn) = DRs(p 一 Pr 
Therefore, P is a fixed point of g(x)， e@ 


Example 2.2. Consider the convergent iteration 
po=0.53 and PHi=e 下 for=01...， 
The first 10 terms are obtained by the calculations 


D1 = e 0500000 - 0.606531 
Po = e 0606531 = 0.545239 
3 一 e 0545239 = 0.579703 


po 一 e 0566409 = 0.567560 
p10 = e 0567560 = 0.566907 


The sequence is converging, and further calculations reveal that 


lim mm = 0.567143 .，.， 
严 一 DO 


Thus we have found an approximation for the fixed point of the function y 一 e <. [ 


The following two theorems estabjlish conditions for the existence of a fixed point 
and the convergence of the fixed-point iteration process to a fixed point, 


Theorem 2.2， Assume that g E C[a, p]. 


(3) 开 the range of the mapping y 三 8(x) satisfies ye [a,b]foralx e [fa,pb],then 
8 has a fixed point in [4a, 有 . 


(4) Furthermore, suppose that 8'(x) is defined over (ca, bp) andthat a positive constant 
玉 < 1 exists with |8'(x)| < 天 < lforalx e(c,b),thenghasauniquefixed 
point P in [ca, . 
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Prpofor(3，  Iea) ==aor8b) 三 D,the assertion is true. Otherwise, the values 
of 8(a) and 8(D) mnust satisfy g(a) ce (ca,D] and 8g() e [a,D). The function F(x) 三 
X 8) has the property that 


fg 和 =a ga<0 and Fo=D 8B)>0. 


Now apply Theorem 1.2, the Intermediate Value Theorem, to 三 (x), with the constant 
下 = 0, and conclude that there exists a number 已 with P e (4a, p) so that F(P) = 0. 
Therefore, 忆 = 8CP)and Pis the desired fxed point of g(x). 

Proofof(4) Now we must show that this solution is unique. By way of contradic- 
tion, let us make the additional assumption that there exist two fxed points Pand 己 . 
Now apply Theorem 1.0, the Mean Value Theorem, and conclude that there exists a 
numberd < (4, p) So that 


8S(P) SC 
PP 刀 


Next， use the facts that 8(P) = 书 and8( 户 ) = 户 tosimplify the right side of 
equation (9) and obtain 


(5) 8 (Cd) = 


8 (dg) = 


户 书 _1 
书 四 


六 
But this contradicts the hypothesis in (4) that |8'(xz)| < 1 over (a,p)，so it is not 


Possible for two fixed points to exist，Therefore, 8(x) has a unique fxed point 己 
in [a, p] under the conditions given in (4). e@ 


Example 2.3， Apply Theorem 2.2 to Tigorously show that 8(x) = cos(x) has a unique 
fxed point in [0, 1 . 

Clearly, 8 e C[0, 1]. Secondly, g(x) = cos(x) is a decreasing function on [0, 1], thus 
its range on [0, 11is [cos(1), 1] S [0, 1]. Thus condition (3) of Theorem2.2 is satisfied and 


8 has a fixed point in [0, 1H]. Finally, 过 x e (0, 1), then lg 三 | sinG)| = Sin(x) < 
sin(1) < 0.841S < 1. Thus KR = Sin(1) < 1,condition (4) of Theorem 2.2 is satisfied, and 
8 has a unique fxed point in [0, ]]. [ 


We can now state a theorem that can be used to determine whether the fxed-point 
iteration process given in (1) will produce a convergent or divergent sequence. 


Theorem 2.3 (ixed-point Theorem). Assume that 人 ) 8,8 ee Cra,D,GDKisa 
Positive constant (iii) po e (a, pb),and (iv)8(C) e [ca,p]ftorallx es [a,z]. 


(6) IgG 生态 < lforallx e [ae,p],thentheiteration pr = 8 UD wi 训 
converge to the unique fxed point 已 < [ca, 中 . In this case, P is said to be an 
attractive fixed point. 


(7) Il8'Co)l > 1foralx e [ce,b,thenthe iteration pn 一 8 1 will not 
converge to P. mn this case, Pis Saidto be arepeling fixed point and the iteration 
exhibits local divergence. 
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| 一 已 - 叫 一 ” 一 一 忆 一 pl | 


2 忆 1 王 Po0 已 


Figure 2.3 ”The relationship among P， po, Pi, | 尼 zol， 
and | 己  P1|. 


Remark 1. lt is assumed that po 尖 P in statement (7). 
Rermar 2. Because 8g is continuous on an interval containing P, it is permissible to use 
the simpler criterion |8'(P)| < 天 < 1and 18'(P)| > 1 in (6) and (7), respectively. 


Proof We first show that the points {pnrjc2o all lie in (a,D).， Starting with po,， we 
apply Theorem 1.6, the Mean Value Theorem. There exists a Value c0 E (a, D) so that 


IP pl=|l8(P) 8(pol=|l8(co(P Po)| 


(8) 
= 18g'(collP pol<KIP pl<1lP pol. 


Therefore， pl is no further from PP than po was, and it follows that PL E (a, p) (see 
Figure 2.3). In general, suppose that pn 1 < (a,D);then 


IP ml=I8CP) sn DI=lg( DOP mm DUI 


(9) 
二 18 (cr IDP pni< 天 IIP mil<lIP Pr il 


Therefore, pn e (C, D) and hence, by induction, all the points {pn]j 吧 0 jlie in (a, 思 ). 
To complete the proof of (6), we wishow that 
(10) lim |P Pi = 0. 
天 一 DO 
First, a proof by induction will establish the inequality 
(1D) IP PrlsKIP zol 


The case7). = 1] follows from the details in relation (8). Using the induction hypothesis 
IP mi<K2 1IP polandtheideas in(9),weobtain 


IP prl<K 天 IIP mm 中 <KK2 1P pol=K"IP pol 


Thus, by induction, inequality (11) holds for al nm. Since 0 < 玉 < 1, the term 大” 
goes to zero asm goes to infinity. Hence 


(12) 0< limn |P ml< lim K"lP pol=0. 
有 一 Do ~ OO 


The limit of | 忆 。 pn|lis squeezed between zero on the left and zero on the Tight, So we 
can conclude that lm _ co|P pr 三 0.Thuslin_ >oo mn = Pand,by Theorem 2.1， 
the iteration P， = 8(Pr 1) converges to the fixed point 忆 . Therefore, statement (6) of 
Theorem 2.3 is proved. We leave statement (7) for the reader to inyestigate. e@ 
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(po0， S(po)) 


Figure 2.4 (a) Monotone convergence when 0 < 8'(P) < 1. 





Rigure 2.4 (b) Oscillating convergence when 1< 83 (P) < 0. 


Corollary 2.1. Assume that 8 Satisfies the hypothesis given in (0) of Theorem 2.3， 
Bounds for the error involved when using Pr to approximate P are given by 


(13) IP pil<KnlP pol foralnm>l， 
and 

开 
(14) IP < 全 JP pol for 同 mn>1 


1 天 
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7=8(O 







(po, 8(Po)) 


Figure 2.S  (a) Monotone diver- 


尼 po Pl 忆 
1 gence when 1 < 8 (P). 


Figure 2.S (人 b) Divergent oscilla- 
tion when 8g'(P) < 1. 





Graphical Interpretation of Fixed-point Iteration 


Since we Seek a fxed point P to 8(x)， it is necessary that the graph of the curve 
y = 383GC) and the line y 一 工 intersect at the point (PP, 忆 )，Two simple types of 
convergent iteration, monotone and oscillating, are illustrated in Figure 2.4(a) and (b)， 
respectively. 

To visualize the process, start at po on the x-axis and move verticallyto the point 
(po, p1) = (po,8(Cpo)) on the curvey = 8(z). Then move horizontally from (po, Pp1) 
to the point (pl1, P1) on the line y 一 x. Finally move vertically downward to _Pl1 on 
the x-aXi8.The recursion pn+l1 = 8(Cpn) is used to construct the point (Ph ， pnr+l) on 
the graph, then a horizontal motion locates (Pr+l, pn+l) on the line y 三 zx, andthena 
vertical movement ends up at pn+l on the x-axis. The Situation is shown in Figure 2.4. 
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Il8'(CP)| > 1,thenthe iteration pn+l 一 8(Pn) produces a sequence that diverges 
away from 妃 . The two simpjie types of divergent iteration, monotone and oscillating， 
are jllustrated in Figure 2.5(a) and (b), respectively. 


Example 2.4。 Considerthe iteration pn+li = 8(pr) whenthefunctiong(x) = 1+xz x2/4 
is used. The fixed points can be found by solving the equation x 一 8(xz). The two solutions 
(fxedpoints of g)arex 三 2andx 一 2.Thederivative ofthe function is g'(xz) 王 1 x/2， 
and there are Only two cases to consider, 


Case (中 忆 一 2 Case (并 忆 一 2 
Start with po= 2.05 Start with po=1.6 
then get P1= 2.100625 then get PD1=1.96 


态 = 2.20378135 
了 3 一 ”2.41794441 


太 二 1.9996 
四 一 1.99999996 


mn oo 
Since j8/(x)| > 和 on[ 3，1H,by The- Since |8'(x)| < 世 on [1,3]，by Theo- 
orem 2.3, the sequence will not converge rem 2.3, the sequence will converge to 
to 忆 = 2， 己 = 2. 


,mm 


Theorem 2.3 does not state what will happen when 8'(P) = 1. The next example 
has been Specially constructed so that the Sequence { Pr] converges whenever po > 己 
and it diverges 让 we choose po < 己 . 


了 Example 2.S。 Considerthe iteration Pr+1 = 8(Pn) whenthe function g(xz) 一 2(0r 1)12? 
forx > 1is used. Only one fxed point 已 = 2 exists. The derivativeis 8g'(x) = 1 TUV2 
and 8'(2) = 1 so Theorem 2.3 does not apply. There are two cases to consider when the 
starting value lies to the left or right of 忆 = 2. 


Case (让 Start with po0 = 1.5， Case (让 Start with po0 = 2.5， 
then get P1 三 1.41421356 then get PD1 一 2.44948974 
”2p2 三 1.28718851 P2 一 2.40789S13 

p3 王 1.07179943 P3 一 2.37309S14 

p4 三 0.$35$90832 P4 一 2.34358284 


_， 1/2 ， _ 
p5=2( 0.46409168)172. ,lim pn 一 2 


Since P4 lies outside the domain of 
go), the term Ps cannot be computed. 


This sequence is converging too slowly 
to the value 已 = 2; indeed，Pi0o0 = 
2.00398714. 
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Absolute and Relative Error Considerations 


In Example 2.$, case (ii), the Sequence converges slowly, and after 1000 iterations the 
three consecutive terms are 


P1000 三 2.00398714，” Plo0l = 2.00398317， and ”Pioo2 三 2.00397921. 


This should not be disturbing; after al], we could compute a few thousand more terms 
and find a better approximation! But what about a criterion for stopping the iteration? 
Notice that 让 we use the difference between consecutive terms， 


|p1ool Piooz| = |2.00398317 “2.00397921| = 0.00000396. 
Yet the absolute error in the approximation P1000 is known to be 
1P pilooo|l = 12.00000000 “2.00398714| = 0.00398714. 


This is about 1000 times larger than |p10o1 ”Piooz| and it shows that closeness of 
consecutive terms does not guarantee that accuracy has been achieved. But it is usually 
the only criterion available and is often used to terminate an iterative procedure. 





function [k,p,err,P]=fixpt(gE,p0,tol,max1) 
% Input - g is the iteration function input as a String 8) 


% -~ BO is the initial guesS for the fixed Point 

六 - tol is the tolerance 

六 - maxl is the maximum number of iterationg 

Youtput -~ K is the number of iterations that Were CarTried out 
-~ P is the apProximation to the fixed Point 

从 - err is the error in the approximation 

色 - P contains the sequence {pnh} 

P(t)= P0; 


for k=2:max1l 
P(k)=feval(g,P(Kk-1) ) ; 
err=abs(P(k)-~P(k-1)); 
relLerr=err/(abs(P (k))+eps) ; 
P=P(K) ; 
if (errctol) | (relerr<ctol) ,breakiend 


end 
if KK == maxl 
disP(maximumnm nunmber of iterations exceeded:) 
end 
P=P，; 


RemaKk， When using the user-defined function fixpt, it is necessary to input the 
M-file g.m as a string: 8 (See MAILAB Appendix). 
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Exercises for Iteration for Solving x = 8(x) 


。Determine rigorously if each function has a unique fixed point on the given interval 


(follow Example 2.3). 

(a) 8gG)=1 xx2/4on [0,1] 
(b) 8C)=2 on[0,1H] 

(cj 8) =1/xon[0.5, 5.2] 


JInvestigate the nature of the fixed-point iteration when 
1 2 
8(O) 一 4 十 4x 了 。 


(al Solve8g) =xYandshowthat 忆 =2andP 一 4arefixedpoints， 

(b) Usethe starting vaiue po = 1.9 and compnute P1, P2,， and P3， 

(Cj] Use the starting value po0 三 3.8 and compnute Pp1,，P2, and P3， 

() Find the errors 玫 and relative errors Rk forthe values px in parts (b) and (c)， 
(el What conclusions can be drawn from Theorem 2.37 


。 Graph 8(x), the line y 一 ,and the given fxed point P on the same coordinate 


system.Using the given starting value po，compute pl and P2，Construct figures 
similar to Figures 2.4 and 2.3. Based on your graph, determine geometricaly 让 fxed- 
Point iteration converges. 

(a] 8gGC)=(6+2L 已 =3,andpm 一 7 

() 8 一 1 十 2/x, 忆 三 2andpo 一 4 

(@j 8GC) =x2/3, 已 = 3,and po =3.5 

(DJ go)= x+2x 十 2, 忆 =2,and po 一 2.5 


。Let g(r) 一 x2 十 Y 4. Can fxed-point iteration be used to find the solution(s) to the 


equationy 一 8(x)27 Why2 


。Let 8(xz) 一 xcos(x). Solvex 三 8C)andfnd all the fixed points of g (there are in- 


finitely many), Can fixed-point iteration be usedto find the solution(s) to the equation 
大 一 8GC)27 Why? 


。Suppose that g(x) and g'(x) are defined and continuous on (a, 站 ; po, pl, p2 e (a,Db); 


and Pl1 = 一 SCpo) and p2 一 8(P1). Also, assume that there exists a constant 玉 Such 


that |s Go)| < 天 .Show thatjpz Pi < 开 IPI pol nt Use the Mean Value 
Theorem， 


。Suppose that 8(xY) and 8'(x) are continuous on (a, 站) and that lg8'(c)| > 1 on this 


interval, Ifthe 人 xed point Pand the initial approximations po and pl lie in the interval 
(a,p),then show that pl 一 8(Cpo) implies that |E =IP pl>|P pol=1zol. 
Hence statement (7) of Theorem 2.3 is established (local divergence). 


.Letg(xz) 一 0.0001xz2 十 x and po = 1, and consider fixed-point iteration。 


(al) Showthat po > pP1>.……> pn> pn+> 
(b) Show that pn > 0forall mm. 
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(c) Since the sequence {Pnj is decreasing and bounded below', it has a limit， What 

is the limit2 
9. Let 8(x) = 0.5x 十 1.$ and po = 4, and consider fxed-point iteration. 

(a) Show that the fxed point is 己 = 3. 

(b) Show thatIP pl=IP pi/2forn 一 12,3,...， 

(ec) Show that | 己 pl=|IP pol/22 formz 一 1,2,3,.... 

10. Let g(x) = xY/2, and consider fxed-point iteration. 

Ga) Find the quantity |Pk+1 PT/IPk+Hl. 

(p) Discuss what will happen 过 only the relative error stopping criterion were Used 
in Program 2.1. 


1L，For fxed-point iteration, discuss why it is an advantage to have g'(P) 0. 


Algorithms and Programs 





1，Use Program 2.1 to approximate the fxed points (if any) of each function. Answers 
should be accurate to 12 decimal places， Produce a graph of each function and the 
liney 一 xthat clearly shows any fixed points. 


(人 a) 8g)=xz5 3x3 2x2 十 2 
() 8G) = cos(sin(x)) 

(c) 8) 一 x2 sin(x 十 0.19) 
个 8CD 一 os 


Bracketing Methodqs for Locating a Root 


Consider a familiar topic of interest. Suppose that you saye money by making regular 
Imonthly deposits 已 and the annual interest rate js 7 then the total amount 4 after N 
deposits ls 


7 7 AN? TANw 1 
1 4=P+PII+ 二 1+PI(I+ 二 .…. 十 忆 一 ， 
(1 十 (+ 吝 )+ (+ 二 ) + 十 (+ 站) 


The firstterm on the right side of equation (1) is the last payment. Then the next-to-last 
payment, which has earned one period of interest, contributes 己 1 十 证). The second- 
from-last payment has earned two periods of interest and contributes 尼 ] 十 十 ) and 
so on. Finally, the last payment, which has earned interestfor N 1 periods, contributes 


忆 1 十 二 ) 1 toward the total. Recall that the formula for the sum of the N terms of 
a geometric Sefies js 


7 人 


1 7 





1 
(2) 1 十 r 十 天 十 方士 十 rY 工 = 
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We can write (1) in the form 


7 7 TANY 1 
az 人 (aa+(+ 站 + 让 
and use the substitutionr 三 (1 十 7/12) in (2) to obtain 
1 (1 十 在 ) 
1 (+ 在 ) 


This can be simplified to obtain the annuity-due equation， 


己 TANX 
(0G3) 4-((+ 光 路 


The following example uses the annuity-due equation and requires a sequence of 
Tepeated calcujations to find an answer. 


4 一 忆 


了 Example 2.6， You save $250 per month for 20 years and desire that the total value of 
all payments and interest is $250, 000 at the end of the 20 years. What interest rate 7 is 
needed to achieve your goal? If we hold AN = 240 fixed, then 4 is a function of 7 alone; 
that is 4 = 4( 门 . We will start with two guesses, 四 一 0.12 and 站 = 0.13, and perform a 
Sequence of calculations to narrow down the final answer, Starting with 10 三 0.12 yields 


250 0.12\240 
4(0.12) =- TD ( 十 车 = 247, 314. 


Since this value is a little short of the goal, we nexttry 厂 = 0.13: 


250 0.13\?240 
4(0.13) = 0 (( 十 区 ) = 282, 311. 





This is a little high, so we try the value in the middle 忆 = 0.125: 


250 0.125\240 
4(0.125) 一 记 7 (( 十 2) = 264, 623， 


This is again high and we conclude that the desired rate lies in the interval [0.12, 0.125]. 
The next guess js the midpoint 7 = 0.12254: 


250 0.1225\240 
4(0.1223) = 一 一 (人 (1 上 + 一 -一 一 . 
5) 0.1225/12 (( 二 一 到 ) ) 255. 803 


This is high and the interval is now narrowed to [0.12, 0.1225]. Our last calculation uses 
the midpoint approximation 妨 = 0.12125: 


250 0.12125\240 
4(0.12125) = 一 一- 一 -一 一 一 . 
(0.12125) 532571 (( 本 ) ) 251, 518 


六 了 人 
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(ao)) (a, Fa)) 





(c, 7c)) 





(cc)) 
人, 7D) (2, 7D) 
(a) If /ac) and Foc) have (b) If Ac) and FLD) have 
Opposite signs then Opposite Signs then 
squeeze from the right. squeeze from the left. 


Figure 2.6 The decision process for the bisection process， 


Further iterations can be done to obtain as many significant digits as Tequired，The 
purpose of this example was to find the value of 7 that produced a specified level Z of the 
fonction value, that is to find a solution to 4(7) = 工 .It is standard Practice to place the 
constant 过 on the left and solve the equation 4( 门 工 =0. 量 


Definition 2.3 (Root of an Equation, Zero of a Functiom)。 Assume that (xz)isa 
continuous function. Any numberr for which Fr) = 0iscalledarootoFtpe eguatior 
jx) = 0. Also, we sayris azero ortje jiezzction Fxz). 全 


For example, the equation 2x2 十 Sr 3 = 0 has two real roots rl 一 0. and 
7 一 3, whereas the corresponding function j(z) = 2x2+TSxr 3 一 (2xr DG 十 3) 
has two real zeros, rl 一 0.5 and 刀 :一 3. 


The Bisection Methodq of Bolzano 


Jn this section we develop our first bracketing method for fnding a zero of acontinuous 
名 nction， We mnust start with an initial interval [a， 站，where ja) and F(b) have 
opposite signs, Since the graph y = jJ (xz) of a continuous function is unbroken, it will 
cross the x-axis at a zerox 一 了 that lies somewhere in the interval (see Figure 2.6). The 
bisection method systematically moves the end points of the interval closer and closer 
together until we obtain an interval of arbitrarily small width that brackets the zero。 
The decision step for this process of interval halving is first to choose the midpoint 
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c=(a 十 D)/2and thento analyze the three possibilities that might arise: 


(4) IF(a) and fc) have opposite signs, a zero lies in [a, c]. 
(9) 下 fc) and jp) have opposite signs, a zero lies in [c, b]. 
(0) IFc) = 0, then the zerolis c. 


Ieither case (4) or (5) occurs, we have found an interval half as wide as the original 
interval that contains the root, and we are“squeezing down on it (see Figure 2.6). To 
continue the process, relabel the new smaller interval [a, p] and repeat the process until 
the interval is as Small as desired. Since the bisection process involves sequences of 
nested intervals and their midpoints, we will use the following notation to keep track 
of the details in the process: 


[co, po] is the starting interval and co 一 2+b is the midpoint. 
8 Po 


[al, pi1] is the second interval, which brackets the zero r, and cl is its midpoint'; 
(7) the interval [al, pi] is haljf as wide as [ao, 50], 


After arriving at the zth interval [an, po], whbich brackets r and has midpoint 
cn the interval [an+1, pn+1] is constructed，which also brackets r and is half 
as Wide as [a，,, 已 ]. 


HL is left as an exercise for the reader to show that the sequence of left end points is 
increasing and the sequence of right end points is decreasing; that js， 


(8) CO<4ES Sm<<Sr< :< 名 SS <b<b0， 
where cn = 4 徊 , andif Fo) FrD < 0,then 
(9) [ax 上 +1， Pr+Hi] 一 [an cp] OFL [an+l, pn+1] = [fc pz] for al 27. 


Theorem 2.4 (Bisection Theorem). Assume that F < C[a,D] and that there exists 
anumberr < [Q,2D] such that Fr) = 0. 开 Fa) and FUD) have opposite Signs, and 


{cnj2o0 represents the sequence of midpoints generated by the bisection process of (8) 
and (9), then 


， aa 
(10) 人 cn| < FTT for 于 一 0，1，.，.， 
and therefore the sequence {cnj220 COnverges to the zerox 一 r; that is,. 
(11) - lim cn 一 7 
天 一 OO 


Proof Since both the zero r and the midpoint cn lie in the interval [au , 包 ], the dis- 


tance between cn and 7 cannot be greater than half the width of this interval (see Fig- 
ure 2.7). Thus 


Dr an 





(12) jr cz| < for all 7”. 
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Figure 2.7 ”The ioot r and midpoint cn of [as, 轨 ] for the 
bisection method. 


Observe that the Successive interval widths form the Pattern 


po ao0 
21 ” 
pl 241 po ao 


2 2 


pl al 一 











It is left as an exerclse for the reader to use mathematical Induction and Show that 





已 G 
(13) om 一 2 
Combining (12) and (13) results in 
(14) r enl < 让 for al nm. 


Now an argument similar to the one given in Theorem 2.3 can be used to show that 


(14) implies that the sequence {cn]220 converges to r and the proof of the theorem is 
complete， 多 


卫 xample 2.7.， The function jz) 一 xsSin(X) occurs in the study of undamped forced 
oscillations. Find the value of x that lies in the interval [0, 2], where the function takes on 
the value Ar) = 1 the function sin(x) is evaluated in radians). 

Weusethebisection methodto fnd a zero of the function fx) =x Sin(x) 1. Starting 
with ao 三 0 and bo = 2, we compute 


0 = 1.000000 and  jC) = 0.818595， 


SO a Ioot of fx) = Oilies in the interval [0,2]. At the midpoint co = 1.we find that 
J (1) = 0.138$29. Hence the function changes sign on [co, 50] = [1, 2]. 

To continue,， we squeeze from the left and set al = co and D1 = 50. The midpoint 
is cl = 1.5 and jcl) = 0.496242. Now,， (1) = 0.158S29 and F(1.5) = 0.496242 
imply that the root lies in the interval [al,cl] = [1.0, 1.$]. The next decision is to squeeze 
from the right and set a2 = Cl and 02 = Cl1. in this manner we obtain a sequence {ckj that 
convefges to 多 1.114157141. A sample calculation is given in Table 2.1. 加 
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Table 2.1 “Bisection Method Soliution of x sin(x) 1=0 


Le 姓 Right 
end point，CK Midpoint， ck end point, 居 


















Function value， 















大 fcb) 
0 0.1$8S29 
1 0.496242 
2 0.186231 
3 0.01S05S1 
4 0.071827 
5 0.028362 
6 0.006643 
7 1.109375S0 1.1171875 0.004208 
8 


1.10937500 1.11328125 1.11718750 


A virtue of the bisection method is that formula (10) provides a predetermined 
estimate for the accuracy of the computed solution. In Example 2.7 the width of the 
Starting interval was p0 40 = 2，Suppose that Table 2.1 were continued to the 
thirty-first iterate; then,， by (10), the error bound would be |E3l| < (2 0) /232 入 
4.656613 x 10 10. Hence ca3l would be an approximation to r with nine decimal places 
of accuracy， The number N of repeated bisections needed to guarantee that the Nth 


midpoint cN is an approximation to a zero and has an error less than the preassigned 
Value 6 js . 


nb am dg) 
(13) A =int ( 王 - 5 。 


The proof of this formula is left as an exercise. 

Another popular algorithm is the metpod or jalse positior or the regzie jzlg 
11le1jaod，IL Was developed because the bisection method converges at a fairly slow 
Speed,， As before, we assume that (ca) and (2) have opposite signs. The bisection 
method used the midpoint of the interval [a, b] as the next iterate，A better approxi- 
mation is obtained if we find the point (c, 0) where the secant line 也 joining the points 
(a, Ja)) and (2, F(D)) crosses the x-axis (see Figure 2.8)， To fnd the value c, we 
write down two versions of the slope mm of the line 了 : 


ag 0 TO 
DP da 
whbere the points (C, F(a)) and (5 F(B)) are used, and 


(17) 11 一 7 
C 
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人 Ha) (2 Ja)) 






(cc Ac) 





?7 = 、 
过 AD) (已 7D)) 
(a) If Xe) and Kec) have (b) If Ac) and KBD) have 
opposite Signs then Opposite signs then 
sdqueeze from the right. squeeze from the left. 


Figure 2.8 The decision process for the false position method. 


where the points (c, 0) and (，j(b)) are used. 
Equating the slopes in (16) and (17), we have 


j) ao 0 AD 
忆 4 ee 


which is easily solved for c to get 


JI) gg) 
(18) C 三 D 二 一 一 一 一 . 

JO) Ta) 
The three possibilities are the Same as before: 
(19) 开 Fa) and fc) have opposite signs, a zero lies in [a, c]. 
(20) 开 Fc) and FJ7have opposite signs, a zero lies in [c, 中 ]. 
(21) 开 F(c) = 0,then the Zero is C， 


Convergenee of the False Position Method 


The decision process implied by (19) and (20) along with (18) is used to construct 
a sequence of intervals {[a, px,]) each of which brackets the zero，At each step the 
approximation of the zero r is 


(pp )(Dn Cr) 
22 7 二 ”一 一 一 一 一 一， 
《9 FU Fo 
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Figure 2.9 The stationary endpoint for the false position 
Imethod. 


and it can be proved that the sequence [cn will converge to r. But beware; although 
the interval width pn an is getting smaller, it is possible that it may not go to zero. 开 
the graph of 》 = j(x) is concave near (r, 0), one of the end points becomes fixed and 
the other one marches into the solution (See Figure 2.9). 

Now we Iework the Solution to xsSin(x) 1=0usingthe method of false posi- 
tion and observe that it converges faster than the bisection method. Also, notice that 
{tr。 an] 和 0 does not go to zero. 


卫 xaimple 2.8， Use the false position method to find the root of xsSin(x) 1=0Othatis 
located in the interval [0, 2] (the function sin(x) is evaluated in radians). 

Starting with ao = 0 and bo = 2, we have 大 (0) = 1.00000000 and 太 (2) 王 
0.81839485S, so a root lies in the interval [0, 2]. Using formula (22), we get 


0.8185948S(2 0) 


一 2 一 一 1.09975017 _ 002001921 
一 081859485 7 and ”co) = “0.02001921 


The function changes sign on the interval [co, bo] = [1.09975017, 2], so we squeeze from 
the left and set al 三 co and p1 = 50. Formula (22) produces the next approximation: 


0.8185948S(2 1.0997S017) 
一 2 一 -1.12124074 
4 0.81859485 (0.0200192]] 


and 


(cl1) = 0.00983461， 


Next f(x) changes Sign on [al,cl] = [1.0997S$017, 1.12124074], and the next decision is 


to squeeze from the Tight and set cz = al and 52 = cl. A summary of the calculations is 
given in Table 2.2. 国 


The termination criterion used in the bisection method is not useful for the false 
position method and may result in an infinite loop. The closeness of consecutive iter- 
ates and the size of | (co)| are both used in the termination criterion for Program 2.3. 
In section 2.3 we discuss the reasongs for this choice. 
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Taple 2.2 ”False Position Method Solution ofx sin(xz) 工 =0 


Left Right 
end point，CK Midpoint， cx end point, 大 















Function value， 















大 cb) 

0 0.00000000 1.0997S017 2.00000000 0.02001921 
1 1.09975017 1.12124074 0.00983461 
2 1.09975017 1.11416120 0.00000563 
3 


1.09975017 1.11415714 1.11416120 0.00000000 





Program 2.2 (Bisection Method)， To approximate aroot of the equation 让 x) = 一 0 


in the interval fa, 由. Proceed with the method only 这 Fox) is continalous and Fa) 
and /(D) have opposite signs. 





function [c,err,yc]=bisect(f,ab,delta) 


YInpPut ~ f is the function input as a string :下 ， 

儿 -~ a and b are the left and right end points 
久 -~ delta is the tolerance 

Youtput -~ c is the zero 

六 - yc=f(c) 

% -~ err is the error estimate for c 


ya=feval(f,a) ; 
yb=feval(f,b) ; 
it yayyb>0 ,break ,end 
max1=1+round((1Iog(b-a)-1log(dqelta))/Log(2) ) ; 
or kxk=1:max1 
c=(a+b)/2; 
yc=feval(f,c); 
if yc== 
a=Cc; 
b=c ; 
elseif yb*yc>0 
b=c; 
yb=yc ; 
elSse 
a=C; 
ya=yc ; 
end 
if b-~-a“ delta，break ,end 
end 
c=(a+b)7V2; 
err=abs (b-a) ; 
yc=feval(f,c); 
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了 Program 2.3 (False Position or Regula Kalsi Method)，To apProximate aroot of 
the equation f (xz) = 0 in the interval [&, b]. Proceed with the method only 让 /zx) 


is continuous and (ca) and (bp) have opposite signs. 





function [c ,err ,yc]=regula(f,a,b,dqelta,epsilon,max1l) 


XInput - f is the function input as a String : 工 ， 

冰 - aandb are the left and Tight end points 

多 - delta is the toLerance for the Zero 

六 -~ epsilon is the tolerance for the value of f at the zero 
% - maxl iis the maximumn number oft iterationSs 

youtput - c is the Zero 

多 -~ yc=f(c) 

人 -~ erT is the error estimate for C 


ya=feval(f ,al); 
yb=feval(f,b) ; 
if ya*+yb>0 
QisPp(?Note: f(a)*f(b)>0?)， 
break， 
enaqQ 
for KK=d :maxl 
qdx=yb*y (b-a)/(yb-ya) ; 
C=b-dx; 
ac=Cc-a; 
yc=feval(f,c); 
If yc==0,break; 
elselif yb*xyc>0 
b=c ; 
yb=yc ; 
el1Se 
a=c; 
ya=yci 
end 
dx=min(abs (dx) ,ac) ; 
if abs(dqx)<delta,break ,end 
if abs(yc)<epsilon,break,end 
endQa 
C， 
erTr=abs (b-a)/2; 
yc=feval(f,c); 
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民 了 Xercises for Bracketing Miethods 





In Exercises 1 and 2, find an approximation for the interest rate 7 that will yield the total 
annuity value 4 让 240 monthly payments 忆 are made. Use the two starting values for 7 
and compute the next three approximations using the bisection method. 


1 
2. 
3. 


忆 =$273,， 4 一 $250, 000, 1 = 三 0.11, 7 = 0.12 
忆 =$325, 4 =$400, 000, 石 = 0.13, 1 = 0.14 


For each function, fnd an interval [ac,b] so that F(a) and F(D) have opposite signs. 
(a) je) 一 er 2 区 

人) Jo)=cosCD) 二 1 x 

(@) JJ)=ln(x) 5 十 zx 

(中 fo 一 xz 10x 十 23 


In Exercises 4 through 7 start with [ao, po] and use the false position method to compute 
Co, Cl1, c2,， and c3. 


4. ex 2 =0,[aopol=[ 2.4，1.6] 
S.、cos(x) 十 1] xx=0,[ao,po] = 10.8,1.6] 
6. In() 5++x =0,[co,po]= [3.2,.4.0] 
7. x2 10x 十 23 = 0, [ao, bo] = 16.0, 6.8] 
8. Denote the intervals that arise in the bisection method by [ao, po0]，[al ,p1]，.，.， 
[an, 2n]. 
(a) Show thatao<al<.…:<a< :andthat.… .<b<…<DI<b0. 
(p) Showthatp， = (po ao)/270. 
(cj Let the midpoint of each iaterval be cu = (an 十 芭 )/2. Show that 
县 
古 pL Review convergence of monotone sequences in your calculus book. 
9，、What will happen 让 the bisection method is used with the function Jo)=LUC 2 
and 
(al) the interval is [3, 7]?2 (b) the interval is [1,7]? 


10. 


开 . 


12. 


What will happen if the bisection method is used with the function F(Cx) = tan(x) 
and 


(a) the interval is [3, 4]? (bthe interval is [1 3]? 


Suppose that the bisection method is used to fnd a zero of F (xz) in the interval [2, 7]. 
How many times must this interval be bisected to guarantee that the approximation 
CN has an accuracy of 3 x 10 9? 


Show that formula (22) for the false position method is algebraicalljy equivalent to 


_ jn) Dj an) 
” Jun 7 
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13. Establish formula (1S) for determining the number of iterations required in the bisec- 


14. 


1S. 


tion method. Hint Use | al/2n"+1 < 8 and take logarithms. 


The polynomial fox) = (xz 1D3(x 2)(C 3)hasthreezeros:x=1of multiplicity 3 
andx 王 2andx=3,eachofmultiplicity I. Ifao and po are any two real numbers 
such that ao < 1 and Zpo > 3, then /ao) jpo) < 0. Thus, on the interval [ao, po] 
the bisection method will converge to one of the three zeros. Ifco < 1 and po > 3 
are Selected such that cn 一 2 is not equal to 1, 2, or 3 for any P > 1, then the 
bisection method will never converge to which zero(S)? Why? 


I a polynomial，F(x), has an odd number of real zeros in the interval [ao, po], and 
each of the zeros is of odd multiplicity， then (ao) 7j(po) < 0, and the bisection 
Imethod will convergeto one of the zeros. Ifao < 1 and po > 3 are Selected such that 
cn 一 4 和 和 is not equal to any of the zeros of f(x) forany 7 过 1,then the bisection 
method will never convergeto which zero(s)? Why? 


Algorithms and Programs 


Ci | 


1 


Find an approximation (accurate to 10 decimal places) for the interest rate 7 that w 记 
yield a total annuity value of $500, 000 证 240 monthly payments of $300 are made， 


。Consider a spherical ball of radius r = 15 cm that is constructed from a Variety 


of white oak that has a density of 0 = 0.710. How much of the ball (accurate to 
8 decimal places) w 记 be submerged when it is placed in water? 


.Modify Programs 2.2 and 2.3 to output a matrix analogous to Tables 2.1 and 2.2， 


Iespectively (ie., the first row of the matrix would be [0 aC0 co po 让 (co)]). 


。Use your programs from Problem 3 to approximate the three smallest positive roots 


of zx 三 tan(x) (accurate to 8 decimal places). 


A unit sphere is cut into two segments by a plane， One segment has three times the 
volume of the other，Determine the distance x of the plane from the center of the 
Sphere (accurate to 10 decimal places). 


[Initial 人 Approximation and Convergence Criteria 


The bracketing methods dependon finding an interval [ea, 站] so that Fa) and F(D) have 
opposite Signs. Once the interval has been found, ao matter how large, the iterations 
will proceed until a root is found. Hence these methods are called gopalzy cortyerge1tt. 
However, 让 F(x) = 0 has several roots in [fa, b],then a different starting interval must 


be used to find each root, It is not easy to locate these Smaller intervals on which (xz) 
changes Sjgn， 


In Section 2.4 we develop the Newton-Raphson method and the secant method for 


solving jx) = 0. Both ofthese methods require that a close approximation to the root 


一 
- 1 


7 
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be given to guarantee convergence. Hence these methods are called iocally corzmyerge1tt. 
They usually converge Imore fapldly than do global ones. Some hybrid algorithms start 
with a globally convergent method and Switch to a localy convergent method when 
the iteration gets close to a root， 

If the computation of roots is one part of a larger project, then a leisurely pace 
is suggested and the first thing to do is graph the function，We can view the graph 
y = jx) and make decisions based on what it ljooks like (concavity, sjope, oscillatory 
bebavior local extrema, infiection points, etc.). But more important, 这 the coordinates 
of points on the graph are available, they can be analyzed and the approximate location 
of roots determined， These approximations can then be used as starting values in our 
root-finding algorithms. 

We must proceed carefully. Computer software packages use graphics software of 
varying sophistication. Suppose that a computer is used to graph y = 丰 (xz) on [a, 中]. 
Typically,， the interval is partitioned into N 十 1 equally spaced points: a 一 x0 < 


XlL < …' <XN 三 Dandthe functionvalues 次 王 COcb computed, Then eithera 
line segment or a“fitted curve”are plotted between consecutive points (xk 1 六 1) 
and (Myk) forK 三 1 2, ...， NThere must be enough points so that we do not 


miss a root in a portion of the curve where the function is changing rapidly. If Foxo) 
is continuous and two adjacent points (ok 1 W 1 and (ck yi lie on Opposite Sides 
of the x-axis, then the Intermediate Value Theorem implies that at least one root lies 
in the interval [Xe 1, Xk]. But 这 there is a root, or even several closely spaced roots， 
in the interval [xkt 1, Xk] and the two adjacent points (xk 1, 闪 1) and (xl 了 从 ) ie on 
the Same side of the x-axis, then the computer-generated graph would not indicate a 
Situation where the Intermediate Value Theorem is applicable. The graph produced by 
the computer will not be a true representation of the actual graph of the function 太 . 
It is not unusual for functions to have“closely”spaced roots; that is, roots where the 
graph touches but does not cross the x-axis,，or roots“close”to a vertical asymptote. 
Such characteristics of a function need to be considered when applying any numerical 
root-finding algorithm. 

Finally, near two closely spacedroots or near adouble root the computer- generated 
Curve between (CE 1 次 上 and (zk 允 ) may fail to cross or touch the x-axis，If 
[jxbl is smaller than a preassigned value e (ie., 太 xi) 鲜 0), then zk is a tentative 
approximate root. But the graph may be close to zero over a wide range of values near 
Xk, and thus Xk may not be close to an actual root Hence we add the requirement that 
the slope change sign near (xk, 次); that is, m，， 一 汪 作 1 and 1mk 一 2 人 mnust 
have opposite signs. Sincexkr 克 1>0andx+l 砍 >0Oitisnot neceSsary to Use 
the difference quotients, and it will suffice to check to see if the differences 允 捧 1 
and.yk+l 其 change Sign， In this case, xk is the approximate root， Unfortunately， 
we cannot guarantee that this starting value will produce a convergent sequence. If the 
graph of y = (xz) has a local minimum (or maximumy) that is extremely close to zero， 
then it is possible that xk will be reported as an approximate root when Fr 冯 0， 
although xx may not be close to a root. 
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Table2.3 “Finding Approximate Locations for Roots 


3.125 0.968 - 1.329 
0.968 0.361 。 。 










Significant changes 


ip pz) or Fr) 






changes sign in [xK 1，,XK] 


changes sign near 其 


changes sign near 欢 


Figure 2.10 The graph of the cu- 
bic polynomial y 一 xz3  x2 yx 十 |. 


了 Example 2.9， Find the approximate location of the roots of x3 X2 YX+i=0onthe 
interval [ 1.2, 1.2]. For illustration, choose N = 8 and look at Table 2.3. 

The three abscissas for consideration are 1.05， 0.3, and 0.9. Because 让 (x) changes 
sign on the interval [ 1.2， 0.9], the value 1.05 is an approximate rooti indeed， 
7 10S) = 0.210. 

Although the slope changes sign near 0.3，we find that 丰 ( 0.3) 一 1.183; hence 

0.3 is not near aroot, Finally, the siope changes sign near 0.9 and F (0.9) = 0.019, so 0.9 
is an approximate root (See Figure 2.10), 国 
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y= 一 e 


Figure 2.11 (a) The horizontal convergence band for locating a_ solution to 


Jo0 = 0 





Figure 2.11 (b) The vertical convergence band for locating a solution to _F xc) = 0. 


Checking for Convergence 


Agraph can beusedto see the approximate location of a root, but an algorithm must be 
used to compnute a value pn that is an acceptable computer solution. Iteration is often 
used to produce a sequence {zK] that converges to a root p, and a termination criterion 
or Strategy must be designed ahead of time so that the computer w 记 stop when an 
accurate approximation is reached. Since the goalis to solve jx) = 0, the fnal vatue 
Pn Should have the property that | (pn)| < 6. 

The user can supply atolerance valuee forthe size of |F(pn)| andthen an iterative 
Process produces points 忆 一 (2 CD) until the last point 忆 lies in the horizontal 
band bounded by the lines y》 = +e andy = 6, as shown in Figure 2.11(a)、This 
criterion ls useful if the user is trying to solve AP(x) 一 工 by applying a root-finding 
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algorithm to the function 夏 x) =P(x) 工 . 

Anothertermination criterion involves the abscissas, and we can try to determine 寺 
the sequence {Ppk] is converging. If we draw the vertical linesx 一 P 十 Sandx 一 忆 0 
on each Side of x 一 p, we could decide to stop the iteration when the point P， lies 
between these two vertical lines, as shown in Figure 2.11(0b). 

The latter criterion is often desired, but it is difficult to implement because it in- 
volves the unknown solution DP. We adapt this idea and terminate further calculations 
when the consecutive iterates pr 1 and Pr are sufficiently close or 过 they agree within 
Ahf significant digits. 

Sometitmes the user of an algorithm will be satisfied f pn 六 pn 1 and other times 
when (pn) 锭 0，Correct logical reasoning is required to understand the conse- 
quences. HI we require that |P PP < 6 and |/(p)| < e, the point 已 will be 
located in the rectangular region about the solution (PP, 0), as shown in Figure 2.12(a)， 
If we stipulate that lp PPl| < 6or ip)| < ee, the point Pi could be located 
anywWhere in the region formed by the union of the horizontal and vertical stripes, as 
shown ip Figure 2.12(b). The size of the tolerances 8 and e are crucial，If the tol- 
erances are chosen too Small iteration may continue forever， They should be chosen 
about 100 times larger than 10 对 ,where M is the number of decimal digits in the 


computer's foating-point numbers. The closeness of the abscissas is checked with one 
of the criteria 


|pP Pr II<6 (estimateforthe absolute error) 
OT 


2|pPn pn 1| 


<6 (esttmate for the relative error). 
pn 十 |Pm 1 


The closeness of the ordinate is usually checked by | 三 (p)| < e， 


Troublesome Functions 


A _ computer solution to jx) = 0 wU almost always be in error due to roundoff 
and/or instability in the calculations，If the graph y》 = jxc) is steep near the Toot 
(P,0), then the root-finding problem is well conditioned (i.e., a solution with several 
significant digits js easy to obtain). If the graph 》 = (x) is shallow near (P, 0), then 
the root-finding problem is 记 conditioned (ie., the computed root may have only a few 


Signifcant digits). This occurs when F(x) has amultiple root at P. This is discussed 
further in the next section. 
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了 iigure 2.12  (a] The rectangular region definedbylr 中 <5ANDIy < 


一 ”~ 二 -一 ”~ 一 ~ 一 -~ 间 en 二 -一 一 一 一 -~-~-~~- 一 ~ 一 -一 一 一 mm ~ 一 ~~~~~ 一 -~ 





1 
】 上 
:= 本 
后 
] 1 
* 


KEigure 2.12 (b) The unbounded region defined by lz 中 <3SORIY <<e. 


一 一 一 一 一 一 一 一 一 ereerairereeoer 一 一 
人 
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Program 2.4 (Approximate Location of Roots)， To roughly estimate the loca- 
tions of the roots of the equation 太 (x) = 0 over the interval [a, 中 ,by using the 
equajly spaced sample points (zk，F(xk)) and the following criteria': 


(OKk DON) < 0,or 


(|I 交 <eand(Ox 以 DO 了 )<0. 
That ls, either (zxk 1) and xck) have opposite signs or | Foxzt)l is small and the 
slope of the curve y》 = (xz) changes sign near (XF， 矿 (x)). 


function R = apPproot (X,epsilony) 


% Input - fis the object function saved as an M-file named f.m 
区 -~ X is the vector of abscissas 

从 - epsilon is the tolerance 

% Output - R is the vector of approximate roots 

Y=f(X) ; 


yrange = max(Y) -min(Y) ; 
epsiJon2 = yrangerepsil1on; 
D=1ength(X) ; 

Im=0 ; 

XCn+l)=X(Cn) ; 

YCn+1)=YCGn) ; 


for KK=2:Dn， 
IE YGk-1)*Y(k)<=0， 
In=m+1T ; 
RCn)=(X(Gk-1)+XCK) 7)V2; 
end 
S=(Y(k)-Y(GK-1))*(Y(k+l)-Y(Gk)) ; 
if (abs(Y(k)) < epsilon2) & (s<=0) ， 
阴 =m+T1 ; 
RGCm)=X(Ck) ; 
end 
end 


Example 2.10. Use approot to find approximate locations for the roots of J(x) = 
sin(cos(x3)) in the interval [ 2， 2]. First save 三 as an M-file named fm. Since the results 
will be used as initial approximations for a root-finding algorithm, we will construct X so 
that the approximations will be accurate to 4 decimal places. 


>>X=~2:.001:2; 
>>apProoct (X,0.00001) 
angs= 


-1.9875 -1.6765 -1.1625 1.1625 1.6765 1.9875 
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Cormparing the resujlts with the graph of /we now have good initial approximations for 
one of our root-finding algorithms, 


Exercises for Initial Approximation 


了 In Exercises 1 through 6 use a computer or graphics calcujator to graphically determine 
the approximate location of the Ioots of Fex) = 0in the given interval，In each case， 
determine an interval [c, bp] over which Programs 2.2 and 2.3 could be used to determine 
the roots (ie.， 丰 (a) (D) < 0)， 


1.、FG)=xz2 erfor 2<x<2 
2。j(x)=X cos(r)for 2<x<2 

3。 丰 (cr) 一 Ssin(x) 2cos(x)for 2<rz<v2 

4.。 (rc) = cos(r) 十 (LI+x2) 1for 2<x<2 
S$. for)==( 人 人 2 ln)for0.3<xY<4.5 
6， 丰 (xz) 一 2x tan(r)for 14<x<1.4 


Algorithms and Programs 





In Problems 1 and 2 use a computeror graphics calculator and Program 2.4 to approximate 
the real roots, to 4 decimal places，of each function over the given interval，Then use 
Program 2.2 or Program 2.3 to approximate each root to 12 decimal places. 


1。F (xz) = 1,000,000x3 111000xz2+1110r lfor 2<xr<2 
2. For) =Sxrl0 38x? 十 21xr8 Srx6 3rx5 Sx2+8r 3for 13<x <15. 


3. A compnuter program that plots the graph of 》 = (xz) over the interval [a, 5p] using 
the points (xo, yo0), (xzt, y1)，...，and (zw, yw) usually scales the vertical height of 
the graph, and a procedure must be written to determine the minimum and maximum 
values of 矿 over the interval. 

.，(a) Construct an aigorithm that will find the values max 三 maxk{X] and 7min 一 
mink [2 
(pb Write a MAILAB program that will fnd the approximate location and value of 
the extreme values of J (xz) onthe interval [a, p]. 
(c) Use your program from part (b) to find the approximate location and value of 
the extreme values of the functions in Problems 1 and 2. Compare your approx- 
imations with the actual vaiues. 
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Newton-Raphson and Secant Methods 
Slope Methods for Finding Roots 


II fxz)，F(x), and PCx) are continuous near a root P, then this extra information 
regarding the nature of fx) can be used to develop algorithms that will produce se- 
quences {Pk] that convergefasterto pp than either the bisection or false position method， 
The Newton-Raphson (or simply Newton's) method is one of the most useful and best 
known algorithms that relies on the continuity of 疡 (x) and P"”(x), We shall introduce 
it graphically and then give a more rigorous treatment based on the Taylor polynomial. 

Assume that the initial approximation Po is near the root PThen the graph of 
yy 一 jx) intersects the x-axis atthe point (p, 0),and the point (po, fj(po)) lies on the 
curvenearthe point (P, 0) (see Figure 2.13). Define pl to bethe point of intersection of 
the xz-axis and the line tangent to the curve at the point (po, 帮 (po)). Then Figure 2.13 
shows that pl will be closer to P than Po in this case. An equation relating Pl and p0 
can be found 这 we write down two versions for the slope of the tangent line 区: 


CD 站 0 了 (po 

Pi  P0 
which is the slope of the line through (P1, 0) and (Po0，F(po)), and 
(2) i 一 三 (p0)， 


which is the slope at the point (Po,， (po))，Equating the values of the slope ma in 
equations (1) and (2) and solving for Pl results in 


(3) DPI = Po JP0) 





记 (po) 





P2 
CD 


地 
地 
~ 
om 
一 
mm 


Figure 2.13 The geometric construction of pl and p2 for 
the Newton-Raphson method. 
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The process above can be repeated to obtain a seduence { PKkj that converges to 也. 
We now make these ideas more precise， 


Theorem 2.S (Newton-Raphson Theorem). Assume that 太 e C “2[a, 5] and there 
exists a number P e [4a,D], where jpD) 一 0.I 太 (Op) 尖 0,thenthere exists as8>0 
Such that the sequence {PkjPo defhned by the iteration 


JP 1 
广 (PE D 


will convergeto p for any initial approximation po E [P 6, 了 十 9]. 
Remark. The function gs(x) defined by formula 


加 了 Cc) 
(5) 8 一 < 


is called the Newtom-Rappsorz iteration ierzctio Since FPD) = 0, it is easy to See 
that 8(p) = Pp. Thus the Newton-Raphson iteration for finding the root of the equation 
太一 0is accomplished by fnding afixed point of the function g(x). 


(4) 底 三 8 三 克 1 for 一 1 2 





Proof The geometric construction of pl1 shown in Figure 2.13 does not help in un- 
derstanding why Po needs to be close to Pp or why the continuity of F”(x) is essential. 
Our analysis starts with the Taylor polynomial of degreez = ] and its remainder term: 


(ec)(x 


2 
(0) Joo0 = /po)+ 疡 (poG po 二 三 A， 


where c jies somewhere between po and x. Substituting x = P into equation (6) and 
using the fact that F(p) = 0 produces 


(ec)(P Po) 
21 
I po is close enough to _p, the last term on the right side of (7) will be small com- 


pared to the sum of the first two terms, Hence it can be neglected and we can use the 
approximation 


(7) 0= (po) 二 (po)(P po) 十 


(3) 0s po)+J(Cpo)(P po)， 


Solving for P in equation (8), we get P 交 p0 COpo)/P(po). This is used to define 
the next approximation pl to the root 


po) 
9 一 . 
(9) P1 二 po 7 0j 


When pk 1isusedinplace of poinequation (9),the generalrule (4) is established. For 
mostapplications this js all that needs to be understood. However to folly comprehend 
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what ls happening，we need to consider the fixed-point iteration function and apply 
Theocrem 2.2 in our situation. The key is in the analysis of 8 (xz): 


JP Ga) AGOD)A  AC)7 (OO 
(FoD)” (CoOD) 

By hypothesis, F(p) = 0; thus 8'(D) = 0. Since 8 (CD) 一 0and g(x) is continuous,it 
is possible to find as > 0 so thatthe hypothesis |8'(Cc)| < 1of Theorem 2.2is satisfied 
on (PP 56,pPT+0)，TIherefore, a sufficient condition for po to initialize a convergent 
Sequence {Pkjt0, Which converges to aroot of fx) =0,isthat poe(p 6p 二 0 
and that 5 be chosen so that 

| /GOOD Go)| 

| Go) 产 


8 CO)=1 


(10) <1l1 foralxece(pP 56p 十 5). @ 


Corollary 2.2 (Newton's Iteration for Finding Square Roots)。 Assumethat 4 > 0 


is areal numberand let po > 0be an initial approximationto VA. Define the sequence 
{Pkj 们 0 using the recursive rule 


4 
PK 1 十 一 一 
(11) 玫 = 一 全 for 大 一 1， 2 ，.... 
Then the sequence { Pi20 converges to VA4;that js, mn >eoo mk 一 VA. 


Outine ofProor Start with the function Foxz) =x2 4,andnotice that the roots of 
the equation x2 4 = 0are 士 VA4. Nowuse J (x) and the derivative (xz) in formula 
(35) and write down the Newton-Raphson iteration formula 








Fo) xX2 4 
12 一 一 一 
(12) SC) 一 并 六 O 基 元 
This formula can be simplifed to obtain 
十 双 
(13) 8(x) = 5 工 . 


When g(x) in (13) is used to define the recursive iteration in (4), the result is formula 
〈1b, can be proved that the sequence that is generated in (11) will converge for any 
starting value po > 0. The details are left for the exercises. e@ 


An important point of Corollary 2.2 is the fact that the iteration function g(x) 
inyolved onjy the arithmetic operations 十 ，，x, and /. 于 g(x) had involved the cal- 
culation of a square rootb we would be caught in the circular reasoning that being able 
to calculate the square root would permit you to recursively define a sequence that will 
conveIge to V4. For this reason, j(xz) = xz2 4 was chosen, becauseit involved only 
the arithmetic operations. 
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Example 2.11. Use Newton's square-root algorithm to find VS. 
Starting with po =2 and using formula (11), we compnute 


_ 2 上 5/2 





万 = 2.25 
) 一 一 = 2.236111111 

太一 22360011 上 302236111111 _ 7236067978 

册 二 236067978 十 5/2.236067978 _ ?36067978 


2 


Further iterations produce PK 久 2.236067978 for 上 > 4, So we see that convergence 
accurate to nine decimal places has been achieved. 最 


Now let us tum to a familiar problem from elementary physics and see why de- 
termining the location of a root is an important task. Suppose that a projectile is fired 
from the origin with an angle of elevation po and initial velocity v0、 In elementary 
Courses, air Tesistance is neglected and we learn that the height 》 = y() and the dis- 
tance traveled xy 三 X(1), measured in feet obey the rules 


(14) yy 一 Di 161 and 和 一 oh 


where the horizontal and vertical components of the initial velocity are vx = vo cos(bo0) 
and 0 一 u0sin(bo), respectively，The mathematical model expressed by the rules 
in (14) is easy to work with, but tends to give too high an altitude and too long a range 
for the projectile's path. 六 we make the additional assumption that the air resistance is 
Proportional to the Velocity, the equations of motion become 


(15) y = FG) = (Cuy 十 32C2) (4 e “5) 32Cr 
and 
(16) x rr) 一 Cu 4 e “5)， 


where C = /K and K is the coefficient of air resistance and m is the mass of the 
projectile, A larger value of C will result in a higher imaximum altitude and a longer 
range for the projectile. The graph of a flight path of a projectile when air resistance is 
considered is shown in Figure 2.14. This improved model is more realistic, but Tequires 
the use of a rootrfinding algorithm for solving /GO) = 0 to determine the elapsed time 
until the projectile hits the ground. The elementary model in (14) does not require a 
Sophisticated procedure to find the elapsed time. 
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了 
300 人 力 =(r(D 7 六 
200 


100 


0 X Figure 2.14 Path of a projectile 
200 400 600 800 1000 with air resistance considered. 


Table 2.4 ”Finding the Time When the Height 三) Is Zero 

















4 Eight 7P 
0 8.00000000 0.79773101 83.22097200 
1 8.79773101 0.05530160 6.68369700 
2 8.74242941 0.00025475 0.03050700 
3 8.74217467 0.00000001 0.00000100 
4 8.74217466 0.00000000 0.00000000 





Example 2.12. A projectile is fired with an angle of elevation bo = 43", yy = vx 一 
160ftsec, and C = 10. Find the elapsed time until impact and find the range. 

Using formulas (1$) and (16), the equations of motion are y = 0) 三 4800(1 
e_WIOD 320r andx =r(0 = 1600(1 ee 10). Since F(8) = 83.220972 and 太 (9) = 
31.534367, we will use the initial guess po = 8. The derivative is (0) 一 480e 10 

320, and its value 广 (po) = 大 (8) = 104.3220972is used in formula (4) to get 
83.22097200 
DPI 一 8 10437220972 二 8.797731010. 
AsumImary of the calculation is given in Table 2.4， 
The value p4 has eight decimal places of accuracy, and the time until impact is ! 祥 
8.74217466 seconds. The range can now be computed using r(b);, and we get 


r(8.74217466) = 1600 4 e 0574217466) = 932.4986302f. 四 


The Division-by-Zero Error 


One obvious pitfall of the Newton-Raphson method is the possibility of division by 
zero in formujla (4), which would occur if 庆 (m 1 = 0. Program 2.5 has a procedure 
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to _ check for this situation，but what use is the last calculated approximation Pk 1 in 
this case? It i8 quite possible that F(pPk 1) ia sufficiently close to zero and that zx 1 
is an acceptable approximation to the root. We now investigate this situation and will 
uncover an interesting fact, that js, how fast the iteration converges. 


Definition 2.4 (Order of a Roob. Assume that F(x) and its derivatives .F(x)， 
...，FU)(xz) are defined and continuous on an interval about x 一 P， We say that 
ex)=0hasarootoforderM atxy 一 疡 让 andonly 让 


(17) 
fj(D)=0， jiDD=0，:， JU DOD=0，and CO(D 夫 0. 
Aroot oforder M = lis often called aszmtple root andifM > litis called a 


12V1ipie roof A rioot of order M = 2is sometimes called a doxpbie rookt and So on. 
The next result will illuminate these concepts， 全 


Lemma 2.1. HI the equation (xz) = 0 has aroot of order M atyx = P, then there 
exists a continuous function 户 (x) so that (x) can be expressed as the product 


(18) FO0 一 DOUHE)， where jp) 天 0. 


Example 2.13. The function Fx) = xz23 3x 十 2 hasasimplerootatp = 2anda 
double root at p = 1. This can be verified by considering the derivatives F(z) = 3x2 3 
and F(xr) = 6x. Atthe valiue pp 一 2,wehave jf(2) = 0and jj( 2) = 三 9,so 


AM = 1lin Dehinition 2.4; hence 闻 一 2isasimple root. For the value P = 1, we have 
0D) = 0 FMD =0, and FA) = 6,soM =2inpDehinition2.4;hence 了 三 1isadouble 
Toot, Also, notice that 让 (x) has the factorization 广 x) 一 (十 2)(x 1)2. 国 


Speed of Convyergence 


The distinguishing property we seek js the following. HPis asimple root of F(x) = 0， 
Newton's method will converge rapidljy,， and the number of accurate decimal Places 
(roughly) doubles with each iteration，On the other hand, 丰 P is a multiple root the 
error in each successive approximation is a fraction of the previous error，、To make 
this precise, we define the order of cortvergertce. This is a imeasure of how rapidly a 
sequence converges. 


Definition 2.S (Order of Convergence). Assume that [pnj?2 0 converges to P and 


set 有 一 D pnforpn >0. 革 two positive constants 4 夭 0and 尺 > 0exist, and 


. ， | 五 
(19) lim |P Po 一 | 2 
moco | 忆 Po moo | 五 p| 





一 4， 
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Table 2.$S Newton"s Method Converges Quadratically at a Simple Root 


力 本 


2.400000000 0.323809524 











0.476190475 













2.076190476 0.072594465 0.076190476 0.619469086 
2.003S96011 0.003587422 0.003596011 0.664202613 
2.000008589 0.000008589 0.000008589 


whb 一 吓 


2.000000000 0.000000000 0.000000000 


then the sequence is Said to converge to with order of convergence 尺 .The num- 
ber 4 is called the asymptotic error constant，The cases 尺 = 1,2 are given special 
consideration. 


(20) 开 尺 三 1,the convergence of [pnj 呈 0 is called Zrear. 
(21) 开 R 一 2,the convergence of {prj22o is called gauadratic. 和 色 


I 开 Ris large, the sequence {Pn} converges rapidly to Pi; that js, relation (19) implies 
that for large values of mn we have the approximation | 已-1| 宇 4| 民 niIR. For example， 
Suppose that 及 = 2 and | 本 | s 10 “2; then we would expectthat |EI SAx1014 

Some sequences converge at a rate that is not an integer and we will see that the 
order of convergence of the secant methodis R = (1 十 VS)/2 s% 1.618033989. 


Example 2.14 (Quadratic Convergence at a Simple Roob。 Start with po = 2.4 


and use Newton-Raphson iteration to find the root p 一 2of the polynomial xz) = 
xz3 37 十 2. The iteration formula for computing {pk] is 

2p3 2 
C2) 有 一 8 1 一 一 人 一 . 

3pk 1 3 


Using formula (21) to check for quadratic convergence, we get the values in Table 2.3$， 四 


A detailed look at the rate of convergence in Example 2.14 will reveal that the error 
in each successive iteration is proportional to the square of the eror in the previous 
iteration. That is， 


lp Ps 4IP 天 请 
Where 4 久 2/3. To check this, we use 


|P 碾 | = 0000008589 and |P 了 2 = 10.003596011|2 = 0.000012931 


and it is easy to see that 


2 
lp。 到 | = 0.000008589 0.000008621 一 jl 2 
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Table 2.6 ”Newton's Method Converges Linearly at a Double Root 

























0 1.200000000 0.096969697 0.200000000 0.515$151515 
1 1.103030303 0.030673883 0.103030303 0.508165253 
2 1.0$2336420 0.025955609 0.0$2356420 0.496751115 
3 1.026400811 0.013143081 0.026400811 0.509753688 
4 1.0132S7730 0.006614311 0.013257730 0.501097775 
4 0.006643419 





1.006643419 0.003318055 0.500550093 


Example 2.1S (Linear Convyergence at a Doubjle Rootb)， Start with po = 1.2 and use 
Newton-Raphson iteration to fnd the double root p = 1 of the polynomial fx) = 23 
3x 十 2. 

Using formula (20) to check for linear convergence, We get the values in Table 2.6， 田 


Notice that the Newton-Raphson method is converging to the double root, but at 
a Slow rate，The values of pk) in Example 2.13 go to zero faster than the values 
of 六 (pb)，so the quotient F(Cpb)/P (pi ip formula (4) is defhined when 愉 关 P. 
The sequence is converging linearly, and the error is decreasing by a factor of approx- 
imately 1/2 with each successive iteration，、The following theorem summarizes the 
pertormance of Newton's method on simple and double roots. 


Theorem 2.6 (Convergence Rate for Newton-Raphson Iteration). Assume that 
Newton-Raphson iteration produces a sequence {Pprj22.0 that converges to the root 忆 
of the function fx).It Pis asimple root, convergence is quadratic and 





|P(pP)| 2 ， 
(23) | 严 a+1| s 一 一 一 一 | 瑟 o| for ”sufficienty large. 
DT ” 
If pis amultiple root of order M, convergence is linear and 
M 1 ， 
(24) | 五 1 空 | 瑟 a| for ”sufhcientiy large. 


M 


了 Pitfalls 


The division-by-zero error was easy to anticipate, but there are other difficulties that 
are not So easy to spot， Suppose that the function is fx) = xz 4x 十 Si; then the 
Sequence {Pkj of real numbers generated by formula (4) will wander back and forth 
from left to right and not converge，A simple analysis of the Situation reveals that 
xz) > 0 and has no real roots， 
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0.1 





0.0 


Po=2 Pi=4 pp 6 


Figure 2.1S ”(a) Newton-Raphson iteration for 矿 (x) 一 
Xe >x can produce a divergent Sequence. 


Sometimes the initial approximation Po is too far away from the desired root and 
the sequence { pk converges to some other root. This usually happens when the Slope 
JP(po) is small and the tangent line to the curve 》 = jx) is nearly horizontal，For 
example, if (xz) 一 cos(x) and we seek the root D = T/2 and start with po 一 3， 
calculation reveals that pl 一 ”4.013$25255, pz = 4.8526S757, ...， and {Pkj w 训 
convergeto a different root 3r/2 欠 4.71238898. 

Suppose that (xz) is positive and monotone decreasing on the unbounded interval 
[a, co) and po > ai then the sequence {PKk} might diverge to 十 co For example, 这 
Gec) =xe and po 一 2.0,then 

P1=4.0， P2 =3S3.333333333，”.……. ， pp15 = 19.723549434， 


9 


and {pkj diverges slowly to 十 oo (see Figure 2.15(a))，Thbis particular function has 
another Surprising problem. The value of 让 (x) goes to zero rapidly as x gets large, for 
example，F(p15) 王 0.0000000536, and it is possible that Pp1s could be mistaken for 
a root， For this reason we designed stopping criterion in Program 2.5 to involve the 
ielative error 2|Pk+1 POPk+10 0, and when 大 = 1$, this value is 0.106817, so 
the tolerance 8 = 10 6 will help guard against reporting a false root. 

Another phenomenon, cycliz8g, occurs when the terms in the sequence [pk tendto 
repeator almostrepeat. For example, if Foxz) 三 x3 XY 3andtheinitial approximation 
is po = 0, then the sequence is 


pi = 3.000000， 有 = 1961$38， 1 = 1.147176， 由 = 0.006579， 
Pp5 一 3.000389， p = 1.961818， 27 = 1.147430， 


and We are stuck in a cycle where 砍 +4 名 了 for 三 0, 1,... (See Figure 2.15(b)， 
But ifthe starting value po is sufficientiy close to the root p 多 1.671699881,then {Pprj 
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Figure 2.15 (bb) Newton-Raphson iteration for /x) 三 
x YX 3canproduce acyclic sequence， 





y= arctan(x) 


Figure 2.1S (人 c) Newton-Raphson iteration for (xy7 三 
arctan(x) can produce a divergent oscillating sequence. 


converges. If po 一 2, the sequence converges: D1 一 1.72727272, p2 = 1.67369173， 
P3 = 1.671702370, and p4 = 1.671699881. 


When |j8'(x)| > 1 on an interval containing the root P, there is a chance of di- 
Vergent oscillation，For example, let Fox) = arctan(x); then the Newton-Raphson 
iteration function ls 8(x) 一 XY (1] 十 x2) arctan(xz), and gx) 一 2xarctan(x),. Ifthe 
Starting value po 一 1.45 is chosen, then 


P1 = 1.330263297，”P2 = 1.845931751， ”pp3 一 2.889109054， 


etc. (See Figure 2.1S(c)). But 坟 the starting value is Sufficiently closeto the root P = 0， 
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pe) 
Oo7po) 





Figure 2.16 The geometric construction of Po2 for the se- 
cant method . 


a convergent Sequence results. 开 po = 0.$, then 
PlL = 0.079S$9S$11， P2 = 0.000335302， p3 三 0.000000000. 


”The situations above point to the fact that we must be honest in reporting an answer. 
Sometimes the sequence does not converge. It is not always the case that after NM 
iterations a solution is found. The user of a root-finding algorithm needs to be warned 
of the situation when a root is not found，If there is other information concerning 
the context of the problem, then it is less likely that an erroneous root will be found. 
Sometimes J(x) has a definite interval in which a root is meaningful，If knowledge 
of the behavior of the function or an“accurate”graph is available, then it is easier to 
choose p0. 


The Secant Method 


The Newton-Raphson algorithm requires the evaluation of two functions per iteration， 
J (pk 1)and F(pk 1). Traditionally,thecalculation of derivatives of elementary func- 
tions could involve considerable effort， But with modern computer algebra software 
packages, this has become less of an issue. Still many functions have nonelementary 
forms (integrals, sums, etc.), and it is desirable to have a method that converges almost 
as fast as Newton's method yet involves only evaluations of (xz) and not of (zx)， 
The secant method will require only one evaluation of fx) per step and at a simple 
root has an order of convergence 尺 久 1.618033989. It is almost as fast as Newton's 
method, which has order 2. 

The formula involved in the secant method is the same one that was used in the 
regula falsi method，except that the logical decisions regarding how to define each 
Succeeding term are different， Two initial points (po, j (po)) and (p1，F(Cpl)) near 
the point (P, 0) are needed, as shown in Figure 2.16，Deftine p2 to be the abscissa 
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Table 2.7 Convergence of the Secant Method at a Simple Root 











1Ek+1 



































EL61 

0 0.200000000 。 0.914152831 
1 0.293401015 0.400000000 0.469497765 
2 0.0839S7573 0.106598985 0.847290012 
3 2.022641412 0.021130314 0.022641412 0.693608922 
4 2.001511098 0.001488S61 0.001S11098 0.825841116 
5 2.000022537 0.000022515 0.000022537 0.727100987 
6 2.000000022 0.000000022 0.000000022 

了 2.000000000 0.000000000 0.000000000 


of the point of intersection of the line through these two points and the x-axis; then 
Figure 2.16 Shows that p2 will be closer to P than to either po or p1. The equation 
relating p2, pl, and po is found by considering the slope 


(025) 帮 二 JPD  A(CPo) and 玫 二 0 JPD 
Pl  P0 P2 PPI1 
The values of m in (23) are the slope of the secant line through the first two apProxi- 


mations and the Slope of the line through (1， 太 (pl)) and (p2, 0),respectively. Set the 
Tight-hand sides equal in (25) and solve for p2 = 8(P1, po) and get 


Jp po) 
JpD) (po 


The general term is given by the two-point iteration formula 


(26) P2 三 8CDl, po) = DPIl 


1PODCk ax D 


27 一 ? 
027) PH 一 8 PK TD= 玫 JP AP D 


Example 2.16 (Secant Method at a Simple Root Start with po = 2.6 and 
pl 三 2.4andusethe secant method to find the root 三 2ofthe polynomial function 
Fo)=z23 3xz 十 2. 

jn this case the iteration formula (27) is 


(Pi 3P 十 2)(PK 下 四 
(28) Pik+l 一 8CDk, Pr 1) 三 了 和 
了 有 1 3 下 十 3pk 1 


This can be algebraically manipulated to obtain 
愉 pk 1 十 杰 愉 1 2 
殉 十 PPk 1 十 玫 1 3 


The sequence of iterates is given in Table 2.7. 国 


(29) PH 三 SP PK 1) 三 
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There is a relationship between the secant method and Newton's method. For a 
polynomial function 太 (x), the secant method two-point formula PH 一 SC PE 
will reduce to Newton's one-point formula pk+l 一 8(Ppkb) 这 pk is replaced by PK 1. 
Indeed,if we replace pm by Pr 1in (29), then the right side becomes the Same as the 
right side of (22) in Example 2.14. 

Proofs aboutthe rate of convergence of the secant method can be found in advanced 
texts on numerical analysis. Let us state that the error termas Satisfy the relationship 


0.618 


j(p) 


《 | 玫 E+1| 之 | 五 | 27D) 








where the order of convergenceis 尺 一 (1 十 V3) /2 尽 1618 and the relation in (30) is 
valid only at Simple roots， 


To check this, we make use of Example 2.16 and the specific values 


|P 55| = 0.000022537 


|P pdall618 = 0.0015110981618 = 0.000027296， 
and 


4=|1F( 2)/27(0 2)10618 = (2/3)0618 -0.778351205， 


Combine hese and it is easy to see that 


|P p5| = 0.000022537 0.000021246 = 4|P Pd4|1618. 


Accelerated Convergence 


We could hope that there are root-finding techniques that converge faster than linearly 
when p is a root of order 1M. Our final result shows that a modification can be made to 
Newton's method so that convergence becomes quadratic at a multiple root. 


Theorem 2.7 (Acceleration of Newton-Raphson Iteration). Suppose that the 
Newton-Raphson algorithm produces 3a sequence that converges linearly to the root 
ZX 三 六 oforderhM > 1 Then the Newton-Raphson iteration formula 


AM 1U) 
31 一 一 人 
GD) 下 一 Pr 1 Fe 


will produce a sequence {PK]R0 that converges quadratically to 己 . 
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Table 2.8 Acceleration of Convergence at a Double Root 































0 1.200000000 0.193939394 0.200000000 0.151515150 
1 1.006060606 0.006054519 0.006060606 0.165718578 
2 1.000006087 0.000006087 0.000006087 

3 


1.000000000 0.000000000 0.000000000 


Table 2.9 ” Comparison of the Speed of Convergence 


Special 
considerations 







Relation between 
SucceSSsive error termas 


Bisection 玖 二 1 写 地 LERl 
Regula falsi 匹 古 1 匀 4 
Secant method Multiple root kK+1 S 友 | 天 | 
Newton-Raphson Multiple root 厂 上 了 1 饼 4 无 引 | 
Secant method Simple root 开 PT1 SALEKTL6I 
Newton-Raphson Simple root 玖 1 必 AA| 甩 2 
Accelerated Mujtiple roat 万 [1 S 同 | 五大 攻 


Newton-Raphson 


了 Example 2.17 (Acceleration of Convergence at a Double Roob. Start with po = 1.2 
and use accelerated Newton-Raphson iteration to find the double root p = 1 of /wx) = 
x3 3x 十 2. 

Since M = 2,the acceleration formula (31) becomes 


一 天 一 
3 


9 


and we obtain the values in Table 2.8. 到 


Table 2.9 compares the speed of convergence of the various root-fnding methods 
that we have studied so far. The value of the constant 4 is different for each method. 
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Program 2.S (Newton-Raphson Iteratiom)，TIo approximate a root of fox) = 一 0 
given one initial approximation Po and using the iteration 





ACE 1) 

了 一 PK 1 广 (e for 天王 1，2，.... 
function [p0,err,Kk,y]=newton(f ,df ,P0,delta,epsilon,maxl) 
YInput -~- f is the object function input as a String : 工 ， 
六 -~ dt is the derivative of f inpput as a String :df， 
4 -~ P0O is the injitial apPTroximation to a Zero of 工 
从 - delta is the tolerance for PO 
扩 -~ epsilon 1i8 the tolerance for the function values 了 
扩 - maxl is the maximum number of iterations 
YoOutput - p0 is the Newton-Raphson approximation to the zero 
多 -~ eIT is the error estimnate for pO 
% ~ K is the number of iterations 
% -~ 了 is the function Value f(p0) 


Tor K=1 :max1 

Pl=pO-feval(f,p0)Vfeval(df ,pP0) ; 

err=abs(p1-P0) ; 

relerT=2#kerr/(abs(P1)+delta) ; 

P0=pl; 

y=feval(f,pO) ; 

if (err<delta) | (relerr<delta) | (abs(y)<epsilon) ,break,end 
end 


了 Program 2.6 (Secant Method)， To approximate a root of fx) = 0 given two 
initial approximations po and pl and using the iteration 


JP ED 
JP) CD D 


function [pl,err,k,y]=secant(f,p0,pl,delta,epsilon,max1l) 
%hInpPut -~ f is the object function input ag a String : 工 ， 


PK+1L 二 PK for 大 一 1，2，.... 





人 ~ P0 and pl are the initial appProximations to a Zero 
% ~ delta is the tolerance for P1 

包 ~ epsilon is the tolerance for the function Values y 
为 -~ maxl is the maximum number of iterations 

%Dutput -~ pl is the Secant method approxjimation to the zero 
~ GT i8 the error estjimate for Pp1 

包 -~ K is the nunber of iterations 

4 ~ 了 is the function value f(Pl) 


for K=T :max1 


4 本 
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p2=p1-feval(f,p1)*(p1-p0O)V(teval(f,pl)-feval(t,pO0)); 
erT=abs (p2-p1) ; 

relerr=2*xerr/(abs(P2)+delta) ; 

P0=pP1; 

Pl=p2; 

y=feval(t ,pl); 

it (err<delta) | (relerr<delta)|(abs(y)<epsilon) ,break ,end 


end 


卫 xercises for Newton-Raphson and Secant Methodqs 


For 


工 . 


problems involving calculations, you can use either a calculator or compnuter. 
Let ro) = 一 z2 xx 寸 2. 

(a) Find the Newton-Raphson formula pz 一 8(DK 1)， 

() Start with po = 1.Sandfnd pl1，p2, and P3. 


.Let Fo) =xz2 7x 3. 


(a) Find the Newton-Raphson formula 由 一 8(pPE 1)， 
(p) Start with po = 1.6 and fnd pl1, p2, and P3. 


(cj) Start with po = 0.0 and find pl1, p2，Pp3, and Pp4. What do you conjecture about 
this sequence? 


. Let ro) = 2)4. 


(a) Find the Newton-Raphson formula pm 一 8(Cpk 1). 
(b) Start with po 三 2.1 and find pl1, p2,，Pp3, and D4. 
(es the sequence converging quadratically or linearly? 


. Let fx) =x3 3x 2. 


(al] Find the Newton-Raphson formula pk 一 g(pk 1). 
(b) Start with po = 2.1 and find Pl1, p2,，p3, and P4， 
(cj) Is the sequence converging quadratically or linearly? 


。Consider the function 帮 (x) = cos(xr). 


(3a) Find the Newton-Raphson formula pk 一 8(PK 1)， 
(We want to fndthe root 了 = 37/2. Can weuse po 一 3? Why? 
(cj We want to fnd the root = 3r/2. Can we use po 一 5? Why? 


。Consider the function 太 (x) = arctan(x)， 


(a) Find the Newton-Raphson formula pk 一 8(PkK 1). 
(j，Ipo =1.0,then find Pl, p2,，p3,and p4. What is limn >oo PK? 
(C) 于 Po=2.0,thenfnd Pi, p2，D3, and P4. What is lim co PK? 
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Consider the function F(x) 一 Xe 1 

(aj) Find the Newton-Raphson formula 大 一 8CDK 1 

(b) I 节 po=0.2,thenfind pl1,p2,p3, and Pp4. What is lmn_ >co PK? 
(ce) 于 po=20,thenfind pi, Pp2，pj, and p4. What is limn_ oo PK? 
( 帅 What is the value of Ap4) in part (c)? 


In Exercises 8 through 10, use the Secant method and formula (27) and compnute the next 
two iterates Pp2 and P3. 


12. 


13. 


14. 
1S 


16 
17 


18. 


。Let fr) =x2 2xz 1.Start with po 一 2.6and pl 一 2.5. 
.Let flx)=x2 xx 3.Startwith po 一 1.7and pl 一 1.67. 


Let fx) =x3 xx 十 2.Startwith pp= 15andpl= 1.52. 


。Cube-root algoritbm.。 Start with Foxz) = xz3 4, where 4 is any real number and 


derive the recursive formula 


2 了 1 十 4/ 卫 
让 = 全 or 2 
3 
Consider F(x) = xN 4, where N is a positive integer 


(a) What real values are the Solution to 让 (x) = 0 forthe various choices of N and 
4that can arise? 


(b) Derive the recursive formula 


ON Dpei+4/ 必 1 


PK 入 


for 大 王 1，2，.... 


forfinding the Nth root of 4. 
Can Newton-Raphson iteration be used to solve jx) =0if Fe) 三 X2 14xr 十 50? 
Why? 
Can Newton-Raphson iteration be used to solve f (x) = 0if Fe) = xl3? Why? 


Can Newton-Raphson iteration be used to solve Fox) =0if roo)=( 3)2and 
the Starting value is Po 一 4? Why? 
Establish the limit of the Sequence in (11). 


Prove that the sequence { Pi ip equation (4) of Theorem 2.5 converges to P. Use the 

following steps. 

(a) Show that 计 pis afixed pointof g(xz) in equation ($) then P is a zero of F(xz). 

(b) 开 pisazeroof fxz)and F(p) 关 0,show that 8'(p) = 0.Use part (b) and 
Theorem 2.3 to show that the sequence [mr in equation (4) converges to 疡 . 


Prove equation (23) of Theorem 2.6， Use the following steps. By Theorem 1.11, we 
can expand (xz) abouty = pk to get 


1 
JoD = JpD+ 太 DC pp 十 5 co P6)2. 
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19 


20. 


21. 


22， 


Since P is a zero of 广 (x), we setx 一 忆 and obtain 


1 
0= (par+ 产 (poDP pb 十 了 (co(P PE)”. 


(a) Now assume that 广 () 关 0ferallx near the root P. Use the facts given above 
and 广 (pk) 天 0to show that 
(Ph) J 太 (ck) 
用 十 DT 一 PT 
Jp 28(CPpR 
(b) Assume that 广 (x) and F7"(x) do not change too rapidly so that we can use the 
approximations 广 (Pk) s jp)and Pet sj"(p). Now use part (a) to get 
了 “(D) 2 
也 人 1 匀 兢 了 . 
7 罗 


己 (PP 





Suppose that 4 is a positive Ieal number, 

(a) Show that 4 has the Tepresentation 4 一 9g X 22m, where 1 /4<9g<1andrmais 
an integeT. 

() Use part (a) to show that the square Toot is 412 = 9g12 x 2m，RemarKk, Let 
Po = (24g 十 1)/3, where 1/4 <g < 1 and use Newton's formula (11). After 
three iterations，P3 will be an approximation to 9g12 with a brecision of 24 
binary digits. This is the algorithm that is often used in the computer's hardware 
to compute square roots. 


(a) Show that formula (27) for the secant method is algebraically equivalent to 
pi 二 上 炎 LACPDt) PkFCDK 1 
Jp CD 


(b) Expliain why loss of significance in subtraction makes this formula inferior for 
computational purposes to the one given in formula (27)， 


Suppose that P is a root of order M = 2 for 1x) = 0，Prove that the accelerated 
Newton-Raphson iteration 

天 二 下， 2/Pk 1) 

(pk 1 


converges quadratically (See Exercise 18). 


aleys metpod is another way to Speed up convergence of Newton's method、The 
Halley iteration formula is 





1/ 1 
go =x Cr) 人 xc)F 号 ) 


广 () 2(7GD)) 
The term in brackets is the modification of the Newton-Raphson formula. Halley's 
method will yield cubic convergence ( 妇 一 3) at simple zeros of 广 (x)， 


(0 Start with Foz) = 六 4Aandfind Halley'"s iteration formula g(x) for find- 
ing V4. Use po 一 2toapproximate VS and compnute P1, p2, and P3. 
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23， 


24. 


(pb) Start with jx) 一 x3 3x 十 2andfind Halley”s iteration formula g(x)、Use 
po= 2.4andcompute pl, p2, and p3. 


Amodified Newton-Raphson method for multipie roots. If pis aroot of multiplic- 

ity M,then Foxz) =( pUqgC),wheredg(p) 天 0. 

(a) ”Show that P(x) = /GOc)/P (zc) has asimple root at 记 . 

(b) Show that when the Newton-Raphson method is applied to finding the simple 
TIootp of P(xY) we get 8() 一 X P(x)/P(xz), which becomes 


0 =x 8 Co)7C0) 

(Po 707 大 (z) 

(C) The iteration using g(xz) in part (b) converges quadratically to 忆 . Explain why 
this happens. 

(d) Zero is a root of multiplicity 3 for the function 太 x) 一 sin(x3)，Start with 


po = 1 and compute Pl1，Pp2，and p3 Using the modiftied Newton-Raphson 
Imethod. 


Suppose that an iterative method for solving /(x) = 0 produces the following four 
consecutive error terms (see Example 2.11): o0 王 0.400000, 天 = 0.043797,，E2 一 
0.000062, and 3 = 0.000000.，Estimate the asymptotic error constant 4 and the 
order of convergence 尺 of the sequence generated by the iterative method . 


Algorithms and Progranas 


1 


Modify Programs 2.5 and 2.6 to display an appropriate error message when (i) di- 
vision by zero occurs in (4) or (27)， respectively， or (i the maximum number of 
iterations, maxl, is exceeded. 


It is often instructive to display the terms in the Sequences generated by (4) and (27) 
(ie., the second column of Table 2.4). Modify Programs 2.5 and 2.6 to display the 
Sequences generated by (4) and (27), respectively. 


: Modify Program 2.5 to use Newton's Square-root algorithm to approximate each of 


the following square roots to 10 decimal places. 
(a) Start with po = 3 and approximate V8. 

(pb) Start with po = 10 and approximate V91. 
(ej) Start with po = 3 and approximate  WV8. 


。Meodify Program 2.5 to use the cube-root algorithm in Exercise 11 to approximate 


each of the following cube roots to 10 decimal places. 
(a) Start with po = 2 and approximate 71/3. 

(b) Start with po = 6 and approximate 2001/3. 

(ej Start with po = 2 and approximate ( 7)173. 
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Modify Program 2.3 to use the accelerated Newton-Raphson algorithm in Theo- 
rem2.7 to fnd the root p of order M of each of the following functions. 


(aj Foo)==( 25,M=5,p=2;startwith po 一 1 
() Fox) = sin(xz3,M = 3,p 一 0;start with po = 1 
(e@j 7)=( 人 (Un AM 一 2,p 一 1)start with po 三 2. 


。 Modify Program 2.5 to use Halley's method in Exercise 22 to find the simple zero of 


jx) 三 X3 3x 十 2， using po = 2.4. 


。 Suppose that the equations of motion for a projectile are 


>y=f(D =9600(1 ee 5200) 480t 
X 一 (一 2400(1 ee 2005)， 


(a) ”Find the elapsed time until impact accurate to 10 decimal places. 


(b) Find the range accurate to 10 decimal places. 


(a) Find the point on the parabola y = x2 that is closest to the point (3, 1) accurate 
to 10 decimal places. 


(pb Find the Point on the graph of y = sin(xz sin(x)) that is closest to the point 
(2.1, 0.3) accurate to 10 decimal places. 


(cj) Find the value of x at which the minimum vertical distance between the graphs 


of 太 (x) 一 Xx2 十 2 and 8(f) = (xX/$) Sin(x) occurs accurate to 10 decimal 
Places. 


， An open-top box is constructed from a rectangular piece of sheet metal measuring 10 


by 16 inches. Squares of what size (accurate to 0.000000001 inch) should be cut from 
the corners 计 the volume of the box is to be 100 cubic inches? 


A catenary is the curve formed by a hanging cable. Assume that the lowest point is 
(0, 0); then the formula for the catenary is y 三 C cosh(x/C) C. To determine the 
catenary that goes through ( 士 a,b) we must solve the equation = C cosh(ae/C) C 
for C， 


(a) Show that the catenary through ( 士 10,6) is y = 9.1889 cosh(x/9.1889) 
9.1889. 


(人 Find the catenary that passes through ( 士 12, 9). 
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Aitken's Process and Steffensen's and Muller?s 
Methods (Optional) 


JIn Section 2.4 we saw that Newton's method converged Slowly at a multiple root and 
the sequence of iterates { Prj exhibited linear convergence. Theorem 2.7 showed how 
to Speed up convergence, but it depends on knowing the order of the root in advance. 


Aitken”s Process 


A technique called 4iztkers A? process can be used to speed up convergence of any 
Sequence that is linearly convergent. In order to proceed, we will need a definition , 


Definition 2.6. Given the sequence {Pnj22 oo, define the forward difference Apr by 
(D Apm = 一 Prn+l Pr ftor7r 之 0. 

Higher powers Ak pn are defined recursively by 

(2) Axmm 一 Ak (Apn) for 大 >2. 和 


Theorem 2.8 (Aitken's Acceleration)， Assume that the sequence {Pnje2 0 con- 


verges linearly to the limit P and thatP 有 头 0foralz > 之 0. Ifthere exists a 
real number 4 with |4| < 1 such that 


G) lim 己 _Pn+l _ 


1 一 OO 忆 PDF ? 


then the Sequence {gnj?2 0 defined by 





(Apn)” (Pn+i )? 
(4) Gn 一 Dr 2 一 Pr Prn+l Pr 
A-Ppr Pr+2 2pn+L 十 Pr 


converges to _P faster than {pnjz2.0, in the sense that 
(3) lim 人 和 = 0. 
天 一 Do 己 Dan 


Proof We will show how to derive formula (4) and will leave the proof of ($) as an 
exercise. Since the terms in (3) are approaching a limit, we can write 





(9) 忆 _Pr+l、 4 and 上 Pt2 SA when mis large. 


忆 Dr 六” Pan+l 
The relations in (6) imply that 


(7) (P pos(P Pr)(P ). 
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Table 2.10 Linearly Convergent Sequence {pn} 




















1 0.606530660 0.039387369 0.5866160609 
2 0.345239212 0.021904079 0.55611935S7 
3 04.379703095 0.012539805 0.573400269 
4 0.360064628 0.007078663 0.563596551 
5 0.$71172149 0.004028859 0.5691S5345 
6 0.564862947 0.002280343 0.566002341 








Table 2.11 “Derived Sequence {qanj Using 
Aitken's Process 
















1 0.567298989 0.000155699 
2 0.367193142 0.000049852 
3 0.567159364 0.000016074 
4 0.367148453 0.000005163 
5 0.567144952 0.000001662 
6 0.567143825 0.000000534 


When both sides of (7) are expanded and the terms p? are canceled, the resujt is 
2 
(8) Pt oa+l 一 四 for 7 一 0，1，.... 
Prn+2 2pnHl 十 Pr 


The formula in (8) is used to define the term 9qn. It can be rearranged algebraically to 


obtain formula (4)，which has less error propagation when computer calculations are 


made. e 


Example 2.18. Show that the sequence {pnj in Example 2.2 exhibits linear convergence， 
and show that the sequence {qn] obtained by Aitken's A? process converges faster 

The sequence {Pn] was obtained by fxed-point iteration using the fonction 8g(z) 一 
e * and starting with po0 = 0.35， After convergence has been achieved, the limit is P 入 
0.567143290. The values pn and grn are given in Tables 2.10 and 2.11, For illustration, the 
value of glis given by the calculation 


1 二 站 (ppD? 
P3 2p2 十 Dl 
.061291448)2 
一 0.60065$30660 (0061291448) 一 0.$67298989. 蚊 


0.093755331 
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1= 和 1 = 用 1=0 1 一 


Figure 2.17 The starting approximations po0，Ppl, and p2 for Mullers method, and the 
differences Po and 六 1 ， 


Although the sequence {4nr] in Jable 2.11 converges linearly, it converges faster 
than {Ppnj in the sense of Theorem 2.8, and usually Aitken's method gives a_ better 
improvement than this. When Aitken's process is combined with fxed-point iteration， 
the result is called Siejjerserzs dcceleratior. The details are given in Program 2.7 and 
in the exercises. 


Mujller” Method 


Mullers method is a generalization of the secant method， in the sense that it does 
not require the derivative of the function. It is an iterative method that requires three 
starting points (po, F(po)),， (pl FFCDUD), and (P2,， (pz)). A parabola is constructed 
that passes through the three points; then the quadratic formula is used to find a root 
of the quadratic for the next approximation，It has been proved that near a simple 
root Mullers method converges faster than the Secant method and almost as fast as 
Newton's method. The method can be used to find real or complex zeros of a function 
and can be programmed to use complex arithmetic. 

Without loss of generality，we assume that p2 is the best approximation to the 
root and consider the parabola through the three starting values, shown in Figure 2.17. 
Make the change of variable 


(9) 1 一 X  2， 

anduse the difference 

(10) ho=p PP and 站 =P P2. 
Consider the quadratic polynomial involving the variable f 


(1b) yy 一 ai 十 叶 十 c. 
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Each point is used to obtain an equation involving a, p, and c: 


At 工 一 jz0: ah 十 ppo 二 c= 万 ， 
(12) At 一 j: a 时 十 pp 十 c 一 万， 
At 一 0: a02 +pb0 +c= 户 . 


From the third equation in (12), we see that 
(13) c= 万, 


Substituting (13) into the first two equations in (12) and using the definition eo = 万 < 
andel= 户 cresultsinthe linear System 
ap6 十 pho 王 万 “=e0， 


(14) 
a 肝 十 bj 一 万 < 


e1. 
Solving the linear System for a and b results in 


eohl elpo 

“” 太 局 “ 启 夺 
加 el77 eopi 
ja Pop 


〈15) 


The quadratic formula is used to find the roots 上 三 zl1, 2z2 of (11): 


2c 
2Z 三 一 一 一 一 . 
六 土 Vb2 4ac 


Formula (16) is equivalent to the standard formula for the roots of a quadratic and is 
better in this case because we know that c = 户 . 

To ensure stability of the method, we choose the root in (16) that has the smallest 
absolute value, 入 > 0, use the positive sign with the square root, and 让 局 < 0, use 
the negative Sign. Then p3 is Shown in Figure 2.17 and is given by 


(10) 


(17) Da = P2 十 Z， 


To update the iterates, choose po and pl to be the two values selected from among 
{Po, pl1, p3j that lie closest to pa3 (i.e., throw out the one that is farthest away). Then re- 
place P2 with 53. Although alot of auxiliary calculations are done in Mujlers method， 
it only requires one function evaluation per iteration. 

下 Mullers method is used to find the real roots of xz) = 0, it is possible that 
one may encounter complex approximations, because the roots of the quadratic in (16) 
mightbe complex (nonzero imaginary components). In these cases the imaginary com- 
ponents willhave a small magnitude and can be set equal to zero so that the calculations 
proceed with real numbers. 
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Table 2.12 ”Comparison of Convergences near a Simple Root 


Muller's Newton's Steffensen 
Imethod method with Newton 


2.600000000 2.600000000 | 2.400000000 2.400000000 
2.400000000 2.300000000 2.076190476 2.076190476 
2.106598985 2.400000000 2.003596011 2.003596011 
2.022641412 1.985275287 2.000008589 1.982618143 
2.001$11098 2.000334062 2.000000000 2.000204982 
2.000022537 2.000000218 2.000000028 
2.000000022 2.000000000 2.000002389 
2.000000000 2.000000000 





天 
0 
1 
2 
3 
4 
相 
6 
了 











Comparison of Methods 


Steffensen's method can be used together with the Newton-Raphson fixed-point func- 
tion gx) = YY /PC)，Imthe next two examples we look at the roots of 
the polynomial (xz) = xz3 3x 十 2，The Newton-Raphson function is g(xz) 一 
(2x3 2)/ (322 3). When this function is used in Program 2.7, we get the calcula- 
tions under the heading Steffensen with Newton in Tables 2.12 and 2.13. For example， 
Starting with po0 一 2.4, we would compute 


(18) P1 = 8(po) = 2.076190476， 
and 
(19) P2 = 8(Di) = 2.003S96011. 


Then Aitken's improvement will give p3 王 1.982618143. 


Example 2.19 (Convergence near a Simple Rootb)、 This is a comparison of methods 
for the function fc) =x3 3xz 十 2nearthe simplerootp 一 2. 

Newton's method and the secant method for this function were given in Examples 2.14 
and 2.16, respectively. Table 2.12 provides a summary of calculations for the methods， 昌 


Example 2.20 (Convergence near a Doubie Root). This is a comparison ofthe methods 
for the function xz) = xz3 3x 十 2 near the double root p = 1. Table 2.13 Provides a 
sumimary of calculations. 国 


Newton's method is the best choice for fnding a simple root (see Table 2.12). Ata 
double roob either Muller's method or Steffensen's method with the Newton-Raphson 
formula is a good choice (see Table 2.13). Note in the Aitken's acceleration formula (4) 
that division by zero can oOccur as the sequence { 有 DK] converges. In this case, the last 
calculated approximation to zero should be used as the approximation to the zero of 厂 . 
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Table 2.13 ”Comparison of Convergence Near a Double Root 


Mnullers Newton's Steffensen 
method method with Newton 


1.400000000 1.400000000 1.200000000 1.200000000 
1.200000000 1.300000000 1.103030303 1.103030303 
1.138461538 1.200000000 1.052356417 1.052356417 
1.083873738 1.003076923 1.026400814 0.996890433 
1.053093854 1.003838922 1.013257734 0.998446023 
1.032853156 1.000027140 1.006643418 0.999223213 
1.020429426 0.999997914 1.003323375 0.999999193 
1.012648627 0.999999747 1.001663607 0.999999S97 
1.007832124 1.000000000 1.000832034 0.999999798 
1.004844757 1.000416075 0.999999999 
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In the following program the sequence {Pkj，generated by Steffensen's method 
with the Newton-Raphson formula, is stored in a matrix COC that has maxl rows and 
three columns、The first column of @ contains the initial approximation to the Toot， 
Po, and the terms DP3，P6, . . .，D3k，. .generated by Aitken's acceleration method (4). 
The second and thlird columns of @ contain the tetrms generated by Newton's Inethod. 
The stopping criteria in the program are based on the difference between consecutive 
terms from the frst column of @， 





了 Program 2.7 (Steffensen”s Acceleration). To quickly find a solution of the fixed- 
point equation x = 8GC) given an initial approximation p0; where it is assumed 
that both 8(x) and 8 (xz) are continuous, |8' (xz)| < 1, and that ordinary fixed-point 
iteration converges Slowly (linearly) to P. 





function [Pp,Q]=steff(f,df ,p0,delta,epsilon;,maxi) 
%TInput - 了 is the object function input as a String :ff 


狼 
关 
儿 


df is the derivative of f input as a String df) 
PO is the initial approximation to aa Zero of 工 
Qelta is the tolerance for PO 


包 - epsilon is the tolerance for the function Values y 
儿 - maxl 1s the maximum number of iterations 

4hDOutput - P is the Steffensen approximation to the Zero 

久 -~ Q is the matrix containing the Steffensen Seduence 


YInitialize the matrix BR 
R=zeros (maxlt ,3) ; 
R(1,1)=PO0; 
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for k=1:maxl 
for j=2:3 
YXDenominator in Newton-Raphson method is calculated 
nzrdenom=feval(df ,RGK,j-1)) ; 


YXCalculate Newton-Raphson apProximations 

if nrdenom== 
"division by Zero ji 记 Newton-Raphson method'， 
break 

el1Sse - 
R(Gk,j)=RGK,j-1)-feval(f,RGK,j-1))Vnrdenom; 

end 


%Denominator in Aitken:S Acceleration Process calLlculated 
aadenom=R(K,3)-2*R(E,2)+RGK 1) ; 


%Calculate Aitken)'8 Acceleration approximations 
If aadenom== 
)division by zero in Aitken?s Acceleration， 
break 
el]1Se 
R(Ck+l,1)=RGKk,1)-(RGK,2)-RCK,1)) 2/aadenom; 
end 


end 


AhEnd Program if division by zero occurred 
if (nrdenom==0) | (aadenom==0) 

break 
end 


AStopping criteria are evaluated 
eIT=abs(R(Gk,1)-RCk+t,1)); 
relLerI=erT/(abs(R(k+l,1))+deltay) ; 
`“y=feval(f,RCGK+l,1)) ; 
if (err<delta) | (relerr<delta) | (y<epsilon) 
% P and the matrix Q are determined 
P=RCk+1l,1); 
Q=R(CL:K+1，:); 
break 
end 


end 
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Program 2.8 (Muller's Method)，To find a root of the equation (xz) = 0 given 


three distinct initial approximations po, Pl, and P2. 





function [p,y,erz]j=muller(f,p0,Ppl,p2,delta epsilon,max1l) 


%IDnput - ff is the object function input a8 Ba String ?f， 

办 -~ pP0，P1，and pP2 are the initial approxjimations 

人 - delta is the tolerance for p0，pl，and Pp2 

办 - epsilon the the tolerance for the function ValueSs y 
入 - maxl is the maximnum number of iterations 

youtput -~ P isg the Mul1Ler apPToximation to the Zero of 工 

人 ~ y is the function value y = f(p) 

多 - err is the error in the approximation of P. 
YInitialize the matrices P and Y 

P=F[FpO p1 p2] ; 


Y=feval(f ,P) ; 


ycalculate a andq b in formula (15) 
for K=Tt:maxil 
hO=P(1)-P(3) ;hl=P(2)-P(3) ;e0=Y(1)-Y(3) ;el=Y(2)-Y(3) ; 3) 
denocom=ht*ho~2-horxh1 ”>2; 
a=(e0*h1-~e1*hO)Vdenom ; 
b=(et*h0"2-e0*rh1`27/denom， 
%Suppress any comp1ex roots 
if b”*2-4*+kaykc > 0 
disc=sqrt(b”2-4x*akc) ; 
elSe 
Qisc=0; 
end 
XFind the smallest root of 〈17) 
ifb<0 
disc=-disc; 
end 
Z=-2x*#c/(b+disc) ; 
P=P(3)7+z; 
%Sort the entries of P to find the two closest to P 
if abs(P-P(2))<abs(P-P(1)) 
Q=[P(2) P(1) P(3)]; 
P=Q; 
Y=feval(E ,P) ; 
end 
if abs(P-P(3))<abs(pP-P(2)) 
R=[IP(CLt) P(3) P(2)] ; 
P=R; 
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Y=feval(fE ,P); 
end 


XReplace the entITy of P that Was farthest from Pp With P 
P(3)=p; 

Y(3) = feval(f,P(3)) ; 

y=Y(3) ; 


YXDetermine StopPping cTiteria 
err=abs(z) ; 
TelerI=err/(abs(P)+deltal) ; 
if (err<delta) | (relerr<delta)| (abs(y)<epsilon) 
break 
end 
end 


卫 xercises for Aitken's, Steffensen's, and Mujllers Methods 


1，、Find Apn， where 


人) 到 =5 (bj) mr=6n 十 2 (c) 亚 三 na 十 H) 
2.Let jpr 一 2102 十 1. Find Akpn, where 
人) 大 一 2 (bj) 大 =3 (c) 大 =4 


3. Let pr 一 1/2”. Show that gn = 0 for all 1, where qn is given by formula (4). 


4. Let Pr 三 1/. Show that gu 三 1/(21 十 2) for all mn; hence there is little acceleration 
of convergence. Does { pnj convergeto 0 linearly? Why? 


S$. Let pm = 1/(24 1).Showthatgr =1/ 42+1 1)foralln， 


06.、The sequence pn = 1/(4" 十 4 ”) converges linearly to 0. Use Aitken's formula (4) 
to fnd qdg1, 92,and 43, and hence Speed up the convergence， 


311 


0.26437542 


7.The sequence { Pr] generated by fxed-point iteration starting with po = 2.5 and using 
the function g(xz) 一 (6 十 2L2 conyverges linearly to p = 3. Use Aitken's formula 
(4) to find gl, qg2, and q3, and hence Speed up the convergence. 
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8. The sequence {pn] generated by fixed-point iteration, starting with po 一 3.14, and 
using the function 8(x) = jn(x) 十 2 converges linearly to D 久 3.1419322，Use 
Aitken's formula (4) to fnd qg1, 92, and 43, and hence Speed up the convergence. 


9. For the equation cos(x) 1 = 0, the Newton-Raphson function is g(z) =x (1 
cos(xz))/ sin(x) 一 xx tan(x/2), Use Steffensen'"s algorithm with g(x) and start with 
Po = 0.3, and find pl1,，P2, and p3; then find p4，P5s, and p6， 


10.， Convergence of series，Aitken's method can be used to speed up the convergence of 
a Series. If the nth partial sum of the series is 


开 
on 一 >》， 4K， 
开 一 ] 
Show that the derived series using Aitken's method is 


42 
Ti = 十 一 -n+l 
“ An+1l An+2 


In Exercises il through 14, apply Aitken's method and the results of Exercise 10 to speed 
up the convergence of the series. 


11. 9 = 人 _1(0.99 关 

12. 3 = 寺 IT 

13. 3 = 赤 : 

14. 9 = 并 动 

1$, Use Mujlers method to find the root of Fo = xz xx 2.Start with po 三 1.0， 
P1 一 1.2,.and p2 一 1.4 and find p3,p4, and p5. 

16. Use Mujllers method to find the root of Fr) 一 4xz2 ex，Start with Po 一 4.0， 
P1 一 4.1,and p2 = 4.2 and fnd p3, p4, and p5. 

17. Let { pnj and {qn] be any two sequences of real numbers. Show that 
人 0) ACm 十 gm) =Apr 十 Adn 
() 和 A(Cpnan) = pn+IAan 十 9gnApn 


18.， Start with formula (8), add the terms pn+2 and pn+2tothe right side, and show that 
an equivalent formaula is 


(pn+2 Pa+l ) _ 


已 祥 Pn+2 二 
人 二 


瑚 ， 


19. Assume that the error in an iteration process satisfies the relation 已 n+1 一 天 瑟 i for 
some constant 玉 and | 天 | < 1. 


(a) Find an expression for 有 that involves E0o, Kand 7 
(b) Find an expression for the smallest integer N so that | 尼 N| < 10 8. 
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Algorithms and Programs 





1 


2. 


Use Steffensen's method witb the initial approximation po = 0.5 to approximate the 
zero of (xz) =X Sin(x) accurate to 10 decimal places. 


Use Steffensen's method with the initial approximation po = 0.$ to approximate the 
zero of (xz) = sin(x3) closest to 0.5 accurate to 10 decimal Places. 


、Use Mullers method with the initial approximations po 一 1.$5，pl = 1.4，and 


p2=1.3tofndazeroof jz) 三 1 二 2x tan(x) accurate to 12 decimal places. 


- In Program 2.8 (Mullers method) a 1 x 3 matrix 忆 is initialized with Po, Pl, and P2. 


Then at the end of the loop, one of the values p0, Pt, or p2 is replaced with the new 
approximation to the zero.This process is continued until the stopping criteria are 
Satisfied,， say at 大 一 玉 ，Modify Program 2.8 so that in addition to D and err, a 
( 开 十 了 x3matrnx OOis produced such that the first row of O contains the 1x3 
matrix 尼 with the initial approximations to the zero, and the Kth row of O contains 


.theKth set of three approximations to the zero. 


Use this modification of Program 2.8 with the initial approximations po0 三 2.4， 
P1 = 2.3, and p2 一 2.2 to find a zero of /xz) = 3cos(x) 十 2sin(xz) accurate to 
8 decimal places. 





The Solution of Linear Systems 
4AX 一 也 


Three planes form the boundary of a solid in the first octant, which is shown in Fig- 
ure 3.1. Suppose that the equations for these planes are 


35x 十 y 十 zZ 三 5 
X 十 4y7 十 Z=4 
X 十 》 十 3z =3. 


What are the coordinates of the point of intersection of the three planes? Gaussian 
elimination can be used to find the solution of the linear System 


X 一 0.76， y=0.68， and zz 一 0.32. 


In this chapter we develop numerical methods for solving systems of linear equations. 


Jntroduction to Vectors and Miatrices 


Areal N-dimensional vector 互 is an ordered set of N real numbers and is usually 
Written in the coordinate form 


(1) 下 一 (X1,xX2，..，XN)， 


Here the numbers xl1, x2,...,andxN are called the compormezts of 三. The set con- 
sisting of all W-dimensional vectors is called N-dizrzentsiomal space. When a vector is 
used to denote a point or position in Space, it is called a posikior yector，、 When it is 
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Figure 3.1 The intersection of three planes， 


used to denote a movement between two points in Space, it is caljed a dzsptacermzentt 
yector. 


Let another vector be 了 = (71, 2 ..，yN). The two vectors 于 and y are said to 
be eqdual if and only ifeach corresponding coordinate is the same; that is， 


(2) 下 = 了 了 这 and ony 丰 了 一 7 for =1 2 ...，N. 


The sumi of the vectors 在 and 了 is computed component by component using the 
definition 


(3) 下 十 了 一 Cl 十 22 十 2 XN 十 yN). 


The negative of the vector 互 is obtained by replacing each coordinate with its 
negative: 


(4) 在 一 ( Xi，xX2,...，XN)， 
The differenhce 了 ls formed by taking the difference in each coordinate: 


(3) 了 有 =(O1 xy xyN XZN). 
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Vectors in NW-dimensional space obey the algebraicproperty 
(0) 7 无 一 了 十 ( 大). 

Ifc is areal number (scalar), we define scalar Mattpiicatiomr c 互 as follows: 
(7) CC 在 一 (cxl, cxX2，...，CXN). 


HIc and d are scalars, then the weighted sum c 瑟 十 dy is calied a Lear co711bi720- 
or of 在 and 了, and we write 


(人 8) CC 下 十 d7 一 (cxl 十 di,cx2 十 dy2，. .cxXN 十 dyN). 


The dot prodrctl of the two vectors 下 and 了 is a scalar quantity (real numberT) 
defined by the equation 


(9) 下 ,了 三 XI 十 22 加 十 :十 XNyN. 
The morzz (or /ezg 续 ) of the vector 和 is defined by 
(10) | 于 = Ge 十 好 十 十 2 


Equation (10) is referred to as the 尼 zeclidearz 1207712 (or Lezzg 续 ) of the vector 大. 
Scalar multiplication c 区 Stretches the vector 天 when |c| > 1 and shrinks the 
vector when lc| < 1. This is Shown by using equation (10): 


le 天 | = (ce 十 cx 十 十 c2x 入 )12 
一 jclGet 十 好 十 十 xD = cl 


An important relationship exists between the dot product and norm of a vector. 下 


both sides of equation (10) are squared and equation (9) is used, with 了 being repiaced 
with 下 , we have 


(49b) 


(12) 上 2 = 好 十 奏 十 十 敬一 天 天， 
开 互 and 了 are Position vectors that locate the two boints (xl x2,,..,XN) and 
(yl1, y2,...，yN) in N-dimensional space, then the dispiacemzeral vector from 互 to 了 


is given by the difference 
(13) 7 了 7 三 (displacement from pbosition 互 to Position 了 )， 


Notice that 这 a particle starts at the position 下 and moves through the displacement 
了 时,its new position is 了 . This can pe obtained by the following vector sum 


(14) 了 一 天 十 (三 三 ). 


Using equations (10) and (13)，we can write down the formula for the distance 
between two points in N-space. 


| 1/2 
0 他 丰 =(o aa02+02 x+ON zx 


When the distance between points is computed using formula 《15)， We say that the 
points lie in N-dimazexsiozzai 尼 uclidearz SPDUCe， 


104 CHAP. 3 THE SOLUTION OFLINEAR SYSTEMS 4X 一 卫 


Example 3.1. Let 一 (2，3,$，1) andy = (6,.1,2，4). The concepts mentioned 
above are now illustrated for vectors in 4-space. 


Sum 下 十 Y =(8，2,7，5) 

Difference 下 了 一 ( 4，4,3,3) 

Scalar multiple 3 下 一 (6，9,1S$，3) 

Length 1 = (4 十 9 十 25 十 DM2 = 391? 

Dot product . 了 =12 3+10+4=23 

Displacement from 下 to 了 7 无 =(4,4，3，3) 

Distance from X to 了 il7 天 1=(16+16+9+91 =50V2 


It is sometimes useful to write vectors as columns instead of rows. For example， 


X1 y1 

2 2 
(16) Xx=| | aa 7=|- 

光 N 了 N 


Then the linear combination c 蔚 十 C7 is 


cxl 十 dy1 


CX2 十 dy2 


CXN 十 dyN 


By choosing c and d appropriately in equation (17), we have the sum ] 蕊 十 17， 
the difference 1 瑟 。 17, and the scalar multiple c 天 十 O7Y, We use the Superscript“ 7” 
fortranspose to indicate that a fow vector shoujld be converted to a column vector and 
Vice versa. 


7 


均 1 XT 
X2 X2 

(18) Go xz2，XN) 一 | and .| = (xl,x2,.…，XN). 
XN XN 


The set of vectors has a Zero element 0, which is defined by 
(19) 0 = (0,.0, ...,0). 


Theorem 3.1 (Vector Algebra)， Suppose that 瑟 , 了 , and Z are N-dimensional vec- 
tors anda and p are scalars (real numbers). Thbe following properties of vector addition 
and scalar multiplication hold; 


(20) 了 十 在 一 下 十 了 commutative property 
(21) 0 十 五 王石 十 0 additive identity 
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(22) 天 夏天 十 (三 )=0 additive inverse 

(23) (天 十 下 十 2Z= 民 十 (了 十 ZI) assSociative DIoperty 

(24) (GaG 十 站 芷 一 0 有 十 已 下 distributive property for scalars 
(25) C 人 (下 十 了 了) 一 0 下 十 QZ distributive property for vectors 
(26)] ap) 一 (CD) 下 asSSociative property for scalars 


Matrices and Two-dimensional Arrays 


A matrix is a rectangular array of numbers that is arranged systematically in rows and 
columns. A matrix having HM rows and N columnsis called an MxN (ead“M by N) 
Imatrix. The capital letter 4 denotes a matrix, and the lowercase Subscripted letter ci/ 
denotes one of the numbers forming the matrix. We write 


(27) 4=[ceij]wxw for 1<i<M1<7<SN， 


Where aij is the number in location ( 避 ] (le., stored in the ith row and jh column 
of the matrix)， We refer to 0ij as the element in location (站 . In expanded form we 
Write 


Cl 42 CQ17 QIN 
GQ21 022 …' 027 0 G2N 
(28) ， = 4. 
IOW 1 一 | 9 Qi2 0 Ci CN 
CQMHI GQGMNH2 … CGMi 0GMN 
column 7 


The rows ofthe M x N matnx 4 are N-dimensional vectors: 
(29) 了 一 (ailai2 .0N) for 王 1， 2，...，Mh. 


The row vectors in (29) can also be viewed as 1 x N matrices, Here we have sliced 
the M x Nmatrix 4 into M pieces (submatrices) that are 1] x N matrices. 

In this case we could express 4 as an M x 1] matrix consisting of the 1 x N row 
matrices Yi ; that is， 


允 1 
VY2 


G0) 4 = y =[v， yz .… Ji .ViM] 


YN 
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Similarly, the columns of the M x N matrix 4 are M xx 1 matrices， 


al1 al17 CGIN 
421 02 7 CQ2N 
(31) CI 一 | ， (= ， CN 二 
ail 下 7 ai ， CiN 
CMI1 CA GAMN 


耳 this case we couldexpress 4 asalxNmatrix consisting ofthe M x 1column 
Imatrices CC 


(32) 4=[Ci C2 Cj CN]. 


卫 xample 3.2. Identify the row and column matrices associated with the 4 x 3 matrix 


2 4 9 
5 7 1 
4=-|o0 3 8 
4 6 5 


ThefourrowmatricesareY1=[ 2 4 9], 2 = [5 7 1]， V3=[0 3 8]， 
andVy4=[ 4 6 5].Thethree column matrices are 


2 4 9 
? 7 1 
4 6 5 
Notice how 4 can be represented with these matrices: 
TY 
了 
和 一 中 一 [C 1 C2 C 3] ， 国 
YY4 


Let4 = [oji] MxN and 咏 = 三 [bi 1MxN be two matrices of the same dimension. 
The two matrices 4 and 另 are said to be equal if and only 让 each corresponding 
element is the same; that is， 

(33) 4= 忆 让 andony 让 oj=b forl<i<M1<J) <N. 


The sum of the two M x N matrices 4 and 下 js computed element by element， 
using the deftinition 


(34) 4 十 马 =[oi 十 Do] for 1<7<M 1<J <N. 
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The negative of the matrix 4 ls obtained by replacing each element with its nega- 
tive: 


(35) 4=[ ay forl<i<M,1<js<N. 


The difference 4 Bis formed by taking the difference of corresponding coordi- 
nates: 


(30) 4 了 =f(aoj px torl<si<M 1<7J<N. 
Itcis areal number (Scalar), we define scalar multiplication c4 as follows: 
(37) c4=[caijiyxNw forl<sr<M 1<) <AN. 


HI 忆 and dg are scalars, the weighted sum p4 十 q 驴 is called a linear combination 
of the matrices 4 and , and we write 


(38) P4 二 94 刀 =[paij 二 dpj]rxw for 1<i<M 1<7J<N. 
The zero matrix of order M x N consists of all zeros: 
(39) 0=f0]MxN. 


Example 3.3. Find the scalar multibles 24 and 3 如 and the linear combination 24 3 劝 


for the matrices 
1 2 2 3 
4 一 7 | and 罗 一 1 4|. 
3 4 9 7 


Using formula (37), we obtain 


2 4 6 9 
24=| 14 10 and 3 号 三 3 12 | ， 
6 8 27 21 


Thelinear combination 24 3 马 is now found: 


2 十 6 4 9 4 5 
24 3 号 =|14 3 10+12|1=|11 22 | . 
6+27 8 21 33 ”29 四 


Theorem 3.2 (Matrix Addition)， Suppose that 4, 8, and C are M x N matrices 


andPp andg are scalars. The following properties of matrix addition and scalar multi- 
Plication holdq: 


(40) 娓 +4 王 4 十 殖 commutative property 

(4bD) 0+4=A4+0 additive identity 

(42) 4 4=4+( 4)=10 additive inverse 

(43) (4 十 万) 十 C 三 4 十 (有 十 C) associative property 

(44) (+9q)4=p4 二 4 distributive property for scalars 
(45) P(4 十 中 ) = P4 十 D 有 distributive property for matrices 


(46) Pa4) = (pa)4 associative property for scalars 
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了 Exercises for Introduction to Vectors and Matrices 


The reader is encouraged to carry out the following exercises by hand and with MATLAB， 
1。、Given the vectors 下 and 了 了 , find (a) 下 十 了 了, (b) 三 了 ,(c)3 瑟 , (d) | 怀 | (e)77Y 4 天 ， 
(人 伸 下 .了 ,and(g) 77 4 蕊 1 
(个 无 =(3，4)andy 王 ( 2,8) 
( 动 天 (6,3,2)andy =( 8,S, 1) 
(ii 大 =(4，8,1)and7=(1，12，11) 
(ivy) 瑟 三 (1，2,4,2)andy 王 (3，S$，4,0) 


2. Using the law of cosines, it can be shown that the angjle 0 between two vectors 下 and 
Y is given by the relation 


下 .了 


0) 三 一 一 一 一 . 
cos(O 一 Ti 六 站 区 


Find the angle, in radians, between the following vectors: 
(a) 互 =( 63,2)andy 一 (2，2,1) 
(b) 互 =(4，8,1)and7y=(3,4, 12) 
3.。 Two vectors 对 and 了 are said to be orthogonal (perpendicular) if the angle between 
thenm is 亏 /2. 
(a) Prove that 不 andy are orthogonal ifand only 让 天 ,了 = 0. 
Use part (a) to determine 计 the following vectors are orthogonal. 
(b) 三 =( 6,4,2)andy =(6,5,8) 
(ec) 三 =( 48,3)and7 =(2,5, 10) 
(d) 下 =( 5,7,2)andy 一 (4,1,6) 
(ej) Find two different vectors that are orthogonal to 天 = (1 2， 9). 


4. Find (a) 4 十 至 , (b) 4 咏 ,and(c)34 28forthe matrices 
1 9 4 4 9 2 
4=| 2 3 6|， 55=| 3 5 7 
0 5 7 8 1 6 


S， The 1rartspose of an M x N matrix 4, denoted 4 is the N x M matrix obtained 
from 4 by converting the rows of 4 to columns of 4/. That is, 让 4 王 [ezj]wrxw and 
4 = [bj]NxMr，thenthe elements satisfy the relation 

六 关 = Qi for 1T<I<M,1<J <AN. 


Find the transpose of the following matrices， 
2 3 12 


4 1 4 9 2 
(a) 7 0 6 (bj) 13 5 7 
8 1 6 

IL1 3 8 
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6。The square matrix 4 of dimension N x Nis Said to be symmetric 计 4 = 4 (see 
Exercise $ for the definition of 4/). Determine whether the following square matrices 
are Symmetric， 


1 7 4 4 7 1 
(3) 7 2 0 () |I0 2 7 
4 0 3 3 0 4 


i 一 ) 


4 
C) 和 三 [ai ,Where ai 一 
(CD) [cz 站 wxN 订 1 二 了 


CoOS(7 fi 一 
(dg) 4= [ar]wxw, whereair = 1 全 ) ， 1/ 
1 1 工夫 j 


7。Prove statements (20), (24), and (2S) 记 Theorem 3.1. 


Properties of Vectors and Matrices 


Alinear combination of the vafiables xl, x2,...,XNis asum 
(1) al1X1 十 Q2X2 十 :十 GNXN 
where ak is the coeffcient of xi for 大 一 1 2 ...，N， 
Alinear equation in xl, x2,...,XN is obtained by requiring the linear combination 


in (1) to take on a prescribed value P; that is， 
(2) ClX1 十 G2X2 十 … :十 CNXN 一 六 . 


Systems of linear equations arise frequently, and 让 M equations in N unknowns 
are given, we write 
CGI11X1L 十 012X2 十 :…… 十 CGINXN 二 如 
C21X1 十 022X2 十 … 十 G2NXN 一 六 2 


G) 


GKIX1 十 Gk2X2 十 … :十 GKNXN 一 中 


QAMI1X1L 十 GhM2X72 十 … :十 GMNXN 一 PDM 


To keep track ofthe different coefficients in each equation, it is necessary to use the 
two Subscripts (K, 门 . The first subscript locates equation 上 and the second subscript 
locates the variable xi)， 、 

Asolution to (3) is a set of numerical values xl, x*2,...,XN that satisfies all the 


equations in (3) Simultaneously, Hence a solution can be viewed as an N-dimensional 
Vectof' 


(4) 有 避 一 (xl X2，...，XN)， 
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了 Rxample 3.4. Concrete (used for sidewalks, etc.) is a Imixture of portland cement, sand， 
and gravel. A distributor has three batches available for contractors,， Batch 1 contains ce- 
ment, sand, and gravel mijixed in the proportions 1/8, 3/8, 4/8; batch 2 has the proportions 
2/10, $/10, 3/10; and batch 3 has the proportions 215, 31S, 0/5. 

Let xl, X2，and x3 denote the amount (in cubic yards) to be used from each batch to 
form a mixture of 10 cubic yards. Also, Suppose that the mixture is to contain p1 一 2.3， 
pb2 一 4.8, and 83 三 2.9 cubic yards of portland cement,， Sand, and gravel, respectively. 
Then the System of liinear equations of the ingredients is 


0.125x1 十 0.200x2 十 0.400x3 一 2.3 (cement) 
(9) 0.37Sx1 十 0.300x2 十 0.600x3 = 4.8 (Sand) 
0.S00x1 十 0.300x2 十 0.000X73 = 2.9 (gravel) 


The solution to the linear system (9) is xz1 = 4,x2 一 3, and x3 一 3, which can be verified 
by direct substitution into the equations; 


(0.125)(4) 十 (0.200)(3) 十 (0.400)(3) = 2.3 
(0.375)(4) 二 (0.300)(3) 十 (0.600)(3) = 4.8 
(0.500)(4) 二 (0.300)(3) 十 (0.000)(3) = 2.9. 国 


Matrix Multiplication 


Definition 3.1.， If 4 = [cgwxw and 嘿 一 [用 站 wxP'are two matrices with the 
Property that 4 has as many columns as 另 has rows, then the matrix product 4 怠 js 
defined to be the matrix C of dimension M x 己 : 


(0) 4 妃 =C = [ci sp， 


where the element cij of C is given by the dot product of the ;th row of 4 and the jh 
column of 妇 : 


AN 
(7) Cij 一 》 aikbkj 一 Gilp11) 十 0i2b21 十 … 十 GiNDN 
| 
for 一 1 2 .Mandy) = 12,..，, 忆 . 国 


了 Example 3.5.。 Find the product C = 4 了 forthe following matrices, and tell why 刀 4 is 


not defined. 
2 3 5 2 1 
4=-| : 站 Ba-| 8 引 


The matrix 4 has two columns and 劝 has two rows，so the matrix product 4 互 is 
defined. IThe product ofa2 x 2 anda2 x 3matrixisa2 x3matrix. Computation reveals 
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2 3][5 2 1 
48=| 1 4 8 5 
I10+9 4+24 2 181_[fl9 20 16|_v 
5+12 2+32 1 24|=| 7 34 25|= 


that 


When an attempt is made to form the product 下 4，we discover that the dimensions are 
not compatible in this order because the rows of 女 are three-dimensional Vectors and the 
columns of 4 are two-dimensional vectors. Hence the dot product of the jthrow of 中 and 
the pth column of 4 is not defined. 国 


If it happens that 4 妨 = 万 4, we Say that 4 and 妃 commnute， Most often, even 
when 4 下 and 玉 4 are both defined, the products are not necessarily the Same. 

We now discuss how to use matrices to represent a jinear System of equations， 
The linear equations in (3) can be wiitten as a matrix product，The coefficients Cj 
are Stored in a matrix 4 (called the coefficient matrix) of dimension AM x N, and the 
unknowns xj are Stored in a matrix 有 of dimension N x 1. The constants px are stored 
in amatrix 号 of dimension AM x 1. Lis conventional to use column matrices for both 
世 and 妨 and write 


al 602 … 和 60 QIN X1 1 
GdG21 62 0j 0 02N 7X2 2p2 
(8) 人 革 一 ” ” |= 三 |， | = 了 . 
al 02 06 kN | | 和 忆 
CNML QM2 QH 0MHN | | xzN DA 


The matrix multiplication 4 天 一 in (3 is reminiscent of the dot product for 
ordinary vectors, because each element px in 妨 ls the result obtained by taking the dot 
product of row Kin matrix 4 with the column matrix 三. 


了 Xample 3.6. Express the System of linear equations (3) in Example 3.4 as a matrix 
product. Use matrix multiplication to verify that [4 3 3] is the solution of (9): 


0.125 0.200 0.400 | | xl 2.3 
(9) 0.375 0.500 0.600 | | 和 妇 | = |4.8 
0.500 0.300 0.000 | 1x3 2.9 


To verify that [4 3 3]' is the solution of (3)，we must show that 4[4 3 3] 一 
[2.3 4.8 2.9] 


0.123 0.200 0.400 | 14 0.5 十 0.6 十 1.2 2.3 
0.375 0.300 0.600 1131=1415+1.5 二 1.8|= 三 |4.8 
0.500 0.300 0.000 | 13 2.0 十 0.9 十 0.0 2.9 
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Some Special Matrices 


The M x N matrix whose elements are all zero is cajlled the zero matraixr or dimaze1z- 
yi01 M x Nandis denoted by 


(10) 0= [0wxw. 


When the dimension is clear, we use 0 to denote the zero matrix. 
The iageritty maatrtr ororder Vis the square matrix given by 


1 _ wheni = 


(11) TN 三 [jwxw where 0 = wheni 类 下 


It is the multiplicative identity, as illustrated in the next example. 


Example 3.7.， Let4 bea2x3matrix. Then 724 = 474 = 4. Multiplication of 4 on 
the left by.72 results in 


1 0||ana ea2 as|_|an+0 az2+0 as 十 0 
0 Tazl azz a23 ad21 十 0 az 十 0 a23 十 0 


Multiplication of 4 on the right by 13 results in 


GII G12 0G13 1 ， 0 _ al+0+0 0+a2+0 0+0+al3 一 4 
CC21 0G22  a23 0 0 1 ”|az 二 0 上 +0 0+az 二 0 0+0+a23| 


Some properties of matrix multiplication are given in the following theorem. 


Theorem 3.3 (Matrix Mujltipiication),， Suppose that c is a scalar and that 4， 妃 ， 
and C are matrices such that the indicated sums and products are defined; then 


(12) (4B)C = 4( 了 CT) associativity of matrix multiplication 
(13) 74=47 王 4 identity matriX 

(14) 4( 瑟 +C)= 王 48 二 A4C left distributive property 

(15) (4 二 BDIC=4CT+ 有 BC Tight distributive property 


(16) c(4 克 ) 一 (c4) 怪 = 4(c 有 ) Scalar associative property 


The Inverse of a Nonsingujlar Matrix 


The concept of an inverse applies to matrices, but special attention must be given. An 
N x Nmatrix 4is called momsizzgrler or invertible ifthere exists an N x N matrix 妃 
'Such that 


(17) 4 呈 一 BA4 王 了. 
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I no such matrix 如 can be found, 4 is said to be Sizgriar， When 妇 can be found 
and(17) holds, we usually write 召 王 4 1andusethe familiar relation 


(18) 44 1=414 证 4is nonsingular. 


It is easy to show that at most one matrix 五 can be found that satisfies relation (17). 
Suppose that C is also an inverse of 4 (ie, 4C = C4 = 了 ), Then properties (12) 
and(13) can be used to obtain 


Determinants 


The determinant of a square matrix 4 is a scalar quantity (real number and is denoted 
by det(4) ofr14|.I4iaNxNmatrix 


411 412 QIN 
G21 ”022 Q2N 
4 = 。 ， 
CQN1 CQGN2 QNN 
then it is customary to write 
QI11 912 QIN 
C21 ”022 G2N 
det(4) 一 。 
CNIL GN2 …” GNN 


Although the notation for a determinant may look like a matrix, its properties are com- 
Pletely different，For one, the determinant is a scalar quantity (real numbenm，The 
definition of det(4) found in most linear algebra textbooks is not tractable for compu- 
tation when N > 3. We will review how to compnute determinants using the cofactor 
expansion method，Evaluation of higher-order determinants is done using Gaussian 
elimination and is mentioned in the body of Program 3.3. 

IH4=[oiisalx1lmatrix, wedefine det(4) = all. I 4 三 [aij]wxN，where 
AN > 2,thenlet hfij be the determinant oftheN 1xN 1submatrixof4obtained 
by deleting the ;th row and jh column of 4. The determinant Mi) is said to be the 
71272O7r 0f Qij，The cojactor 4ij of aij is defined as 4i 三 (人 Ti7HNi Then the 
determinant of an N x Nmatrix 4 is givenby 


N 
(19) det(4) 三 》， aij4ij (ith row expansion) 
=1 
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N 
(20) det(4) 一 >》， 4j4i (th column expansiomn). 

1 一 | 

Applying formula (19), with = 1, to the 2 x 2 matrix 
4 二 罗 2 
Q21  G22 

we See that det4 = alla22 ”al2421. The following example illustrates how to use 


formulas (19) and (20) to recursively reduce the calculation of the determinant of an 
N x N matrix to the calculation of a number of 2 x 2 determinants, 


卫 xample 3.8. Use formula (19) with = 1 and formula (20) with / = 2 to calculate the 
determinant of the matriX 


Using formula (19) with il 三 1, we obtain 


上 局 
人 hn 
司 一 0o 
L 一 | 


5$ 1 4 1 4 5 
det4 = (2) 6 (3) 7 十 四 7 3 
=(2)(45 0) (3)( 36+7)+(8)(C24 35) 
一 77. 


Using formula (20) with 7 = 2, we obtain 


det(4) = g)| 7 中 + (9| 1 


一 77. 国 


The following theorem gives sufficient conditions for the existence and uniqueness 
of solutions of the linear System 4 互 三 号 for square coefficient matrices. 


Theorem 3.4. Assume that 4 is an N x N matrix. The following statements are 
equivajlent. 


(21) Given any N x 1 matrix 妨 , the linear system 4 瑟 王妃 has aunique solution. 
(22) The matrix 4 is nonsingular (i.e., 4 1 exists). 


(23) The System of equations 4X = 0 has the unique solution 五 = 0. 
(24) det(4) 关 0. 
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Thbeorems 3.3 and 3.4 help relate matrix algebra to ordinary algebra， If state- 
ment (21) is true, then statement (22) together with properties (12) and (13) give the 
following line of reasoning: 


(25) 4 下 一 忆 implies 4 14= 4 18， whichimplies 天 二 4 18， 


Example 3.9， Use the inverse matTrix 


and the reasoning in (2$) to Solve the linear System 4 天 一 陷 : 


13 Hz 2 
Ar] 加 = 加- 
Using (25), we get 


ci 尖 - 洒 -了 罗  ， 


Remark.， In practice we never numerically calculate the inverse of a nonsingular 
matrix or the determinant of a Square matrix， These concepts are used as theoretical 
“tools”to estabjlish the existence and uniqueness of solutions or as a means to alge- 
braically express the solution of a linear System (as in Example 3.9). 


Plane Rotations 


Supposethat4isa3x3matrix and 忆 y 一 [ y z] ia3x1lmatrixi then theproduct 
Y =A4Uisanother3 x 1 matrnx， This is an example of a linear transformation, and 
applications are found in the area of computer graphics，The matrix U is equivalent 
to the Positional vector Z 王 (x, y, z), which represents the coordinates of a point im 
three-dimensional space. Consider three special matrices: 


1 0 0 
(20) 及 rr(a) 王 |10 cos(a) Sin(a) | ， 
0 Sin(Q) cos(a) 


cos(B) 0 sin(p) 
(27) 有 R(B) = 0 ] 0 |， 


sin(B8) 0 cos(p) 
Cos(7) Sin(O7) 0 


(28) 民 z(7Y) 一 | sin(7) cos(Y) 0 
0 0 1 
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Table 3.1 “Coordinates of the Vertices of a Cube under Successive Rotations 








忆 一 及 :下 ) 忆 砚 = 尺 下 ) 玉 。 下) 芝 
(0,0,0)/ (0.000000, 0.000000, 0)/ 《0.000000, 0.000000, 0.0000007/ 
(0,0)/ (0.707107, 0.707107, 0)/ (0.612372, 0.707107， 0.353553)/ 
(0, 1,0)/ ( 0.707107, 0.707107, 0)/ 〈 0.612372, 0.707107, 0.353553)/ 
(0,0, 1 (0.000000, 0.000000, 1)7 (0.500000, 0.000000, 0.866025)/ 
(1 0)/ (0.000000, 1.414214, 0)/ (0.000000, 1.414214, 0.000000)/ 
(0, 1 (0.707107, 0.707107, 1)/ (1.112372, 0.707107, 0.512472)/ 
(0, 1 1 ( 0.707107, 0.707107, 1)/ ( 0.112372, 0.707107, 1.219579)/ 
(1 TU/ (0.000000, 1.414214, 1 (0.500000, 1.414214, 0.866025》/ 





These matrices 玉 xz(a),， 尺 )(B)，and 民 z(Y) are used to rotate points about the xz-，y-， 
and z-axXes through the angles w, 8, and y，respectively，、The inverses are 尼 :( a)， 
及 )( ,and 尺 :( 7) and they rotate Space about the x-，y-, and z-axes through the 
angles ww， p, and yy,respectively. The next example illustrates the Situation, and 
further investigations are fieft for the reader. 


匡 xample 3.10. A unit cube is Situated in the first octant with one vertex at the origin. 
First, rotate the cube through an angle T/4 about the z-axis; then rotate this image through 
an angle/6 about the y-axis. Find the images of all eight vertices of the cube， 

The first rotation is given by the transformation 


元 cos( 所 ) sin( 节 ) 0||x> 
=RR. (了 ) 口 = |sinG) ecos( 下 0| jy 
4 0 0 1| | > 


= | 0.707107 ”0.707107 0.000000 


0.707107 0.707107 “0.000000 藉 
0.000000 ”0.000000 1.000000 


乙 


Then the Second rotation is given by 


cos( 范 ) 0 sin( 天 ) 
到 =R， (5)7= 0 1 0 |r 
Sin( 受 ) 0 cos( 秋 ) 
0.866025 ”0.000000 0.500000 | . 
一 0.000000 1.000000 “0.000000 | Y. 
0.S00000 “0.000000 “0.866025 


The composition of the two rotations is 


_ _ 0.612372 ”0.612372 ”0.5000001] 「x 
色 =R， (5) R。 () 忆 = | 0707107 ”0.707107 0.000000| jy 
0.353553 。 0.353553 ”0.866025 | | z 
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(O) (b) (O 


Figure 3.2 (al) The original starting cube. (b) Y = 丸 :(r1/4)77. Rotation about 
the z-axXis. (c) 灵 一 尽 (CT/16)Y. Rotation about the y-axis， 


Numerical computations for the coordinates of the vertices of the starting cube are given 识 
Table 3.1 (as positional vectors), and the images of these cubes are shown in Figure 3.2(a) 
through (c). _ 国 


MATLAB 


The MAILAB functions det(A) and inv(A) calculate the determinant and inverse 
(ft Ais invertible), respectively of a square matrix 人 ， 


Example 3.11.。 Use MAILAB to solve the linear system in Example 3.6. Use the inverse 
matrix method described in (2S). 


Pirst we vetify that 4 is nonsingular by showing that det(4) 尖 0 (Theorem 3.4). 


>>A= [0.125 0.200 0.400;0.375 0.500 0.600;0.500 0.300 0.000] ; 
>>det(A) 
ansSs= 

-0.0175 


Eollowing the reasoning in (2S), the soiution of 4 无 一男 is 斑 一 4 17. 
>>X=jinv(A)*x[2.3 4.8 2.9]， 


= 
4.0000 
3.0000 
3.0000 
-We can check our solution by verifying that 4 天 一 瑟 . 
>> 卫 = 太 水 双 
B= 
2.3000 
4.8000 


2.9000 和 
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了 Exercises for Propberties of Vectors and Miatrices 





The reader is encouragedto carry out the following exercises by hand and with MATLAB. 
1.Find 48 and 路 4 for the following matrices: 


[3 引 <E 


2. Find 4 录 and 史 4 forthe following matrices. 


3 0 
4=|: " 引 B-| 1 5|. 
3 2 


3. Let 4, 有 ,and C be given by 


全 二 | 


(a) Find (4)C and 4(BC)， 
(b) Find 4( 瑟 十 C) and 4 妃 十 4C. 
(c) Find(4 十 BDIC and4C 十 马 C. 
(d) Find (4 号 )' and 吾 ' 4 
4 We use the notation 42 = 44. Find 42 and B82 for the following matrices: 


2 0 46 
4=| 3 引 B=-| 1 5 4 
3 5 2 


1 7 2 0 6 
(a) | 5 | () 1 SS 4 
3 5 2 
1 2 3 4 
1 2 
@ |3 4 dd) 0246 
0 0 005 4 
000 7 
6. Show that 尺 :(a)Rxr( wa) 三 了 by direct multiplication of the matrices 灵 :(a) and 


及 a); (See formula (26)). 
7. (a) Show that Re(a) 尺 (6) 一 
cos(B) 0 sin(B) | 


sin(B) sin(w) cos(a) cos(B) sin(a) 
cos(a)] Sin(B) Sin(aw) cos(B) cos(a) 


(see formulas (26) and (27)). 
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(b) Show that 尺 y(B) 玉 xfto) 一 
cos(B) sin(B) sin(a) cos(x) sin(B) 
0 


cos(Q) - Sin(Qo) 
sin(Q) cos(B) sin(w) cos(B) cos(o) 


. If4andBarenonsingularNx N matrices andC 一 4 有 ,show tat C 1I= 有 14 1!. 


Hint Use the associative property of matrix mnultiplication. 


。Prove statements (13) and (16) of Theorem 3.3. 
10. 


Let&beanMxNmatrixand 大 anN xlmatrix， 
(a) How many multiplications are needed to calculate 4 用 7 
(b) How many additions are neededto calcujlate 4 导 ? 


Let 4 be an M x Nmatrix, andlet 刀 andCbeNxP matrices，Prove the left 
distributive law for matrix multiplication: 4( 吾 十 C) = 4 号 十 4C. 


Let AandBbeMxNmatrices,andletCbeaNxPmatrixX，Prove the right 
distributive law for matrix multiplication: (4 十 )C = 4C 十 卫 C. 


Find 下 届 ' and 下/ 于 ， where 于 二 [1 1 2].Note. 开 isthetranspose of 革 ， 


Let4beaMxNmatrixand 召 aNxPmatrix. Provethat(4 有 ) 王 吾 4. 瑟 nt Let 
C = 4 有 andshow,usingthe definition of matrix multiplication, that the (人 7] 了 hentry 
of C' equals the (Gi， 六 th entry of B 4 

Use tbe result of Exercise 14 and the associative property of matrix Imultiplication to 
show that (4BC) = C /号 4. 


Algorithms and Programs 
ee 


The first column of Table 3.1 contains the coordinates of the vertices of a unit cube situated 
in the first octant with one vertex at the origin. Note that all eight vertices can be Stored in 
amatrix V of dimension 8 x 3，where each row represents the cootdinates of one of the 
vertices. It follows from Exercise 14 that the product of Z and the transpose of 尺 z(T/4) 
will produce a matrix of dimension 8 x 3 (representing the second column of Table 3.1， 
Where each row Tepresents the transformation of the corresponding row in 忆 )， Combining 
this idea with Exercise 1S, it follows that the coordinates of the vertices of a cube under 
any number of successive rotations can be represented by a matrix product. 


工 


Aunit cube is situated in the first octant with one Vertex at the origin，First rotate 
the cube through an angle of /6 about the y-axis; then rotate this image through an 
angle of z/4 about the z-axis，Find the images of all eight Vertices of the starting 
cube. Compare this result with the result in Example 3.10. 
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区 


(W) 人 (c) 


Figure 3.3 〈a) The original starting cube. (b)VY = 丸 ,(r/6)U. Rotation about 
the y-axis. (c) 村 = 民 :(T/14)Y. Rotation about the z-axis， 


What is different? Explain your answer using the fact that, in general, matrix mul- 
tiplication is not commutatiye. (See Figure 3.3(a) to (c)). Use the plot3 command to 
plot each of the three cubes， 


2 Aunit cube is situated in the first octant with one vertex at the origin， First， Totate 
the cube through an angle of rr/12 about the x-axis; then Totate this image through 
an angle of /6 about the z-axis， Find the images of all eight vertices of the starting 
cube. Use the plLot3 command to plot each of the three cubes. 


3.， TIhe tetrahedron with vertices at (0, 0 0), (1 0,0), (0, 1,0), and (0 0, 1) is first ro- 
tated through an angle of 0.15 radian about the 7-axis，then through an angle of 
1.5 radians about the z-axjis, and finally through an apgle of 2.7 radians about the 
XZ-axXis、 Find the images of all four vertices. Use the Plot3 command to plot each of 
the four images. 


Upper-triangujlar Linear Systems 


We will now develop the pucj-supstilzufiomn algortipzae, which is useful forsolving alin- 
ear System of equations that has an Upper-triangular coe 值 cient matrix. This algorithm 
will be incorporated in the algorithm for solving a general linear System in Section 3.4. 


Definition 3.2， An N x N matfix 4 = [aij]iscalled upper 1riazguicr provided that 
the elements satisfy aij = 0 wheneveri > ). TheN x Nmatrx 4=[a 门 is called 
Jower tria1zguiar provided that aij = 0 wheneveri < 六 全 


We wil develop a method for constructing the solution to upper-triangular linear 
Systems of equations and leave the investigation of lower-triangular systems to the 
reader I 4 is an uppertriangular matrix, then 4 天 = 已 is said to be an xpper- 
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17ria1zguLr Syste1z of linear equations and has the form 


QI11X1I 十 Q12X2 十 G13X3 十 十 QIN IN 1 十 CINXN 一 四 
Q22X2 十 023X3 十 … 十 G2N 17N 1 十 Ga2NXN 一 2 
33X3 十 … :十 GaG3N 1XN 1 十 Ga3NXN 一 D3 


(4D 


QN 1lN 1XN 1 十 CN 1NXN 一 PN 1 
CQNNXRN 一 PN. 


Theorem 3.S (Back Substitution)， Suppose that 4 互 = 驴 is an upper-triangular 
System with the form given in (]. 开 


(2) akk 藉 0 for 大 一 1，2，...，N， 
then there exists a unique Solution to (1). 


Co1lstructive ProoF The solution is easy to find, The last equation involves only xN， 
SO We Solve it first: 


GO) xy on 


Now xzN is known and it can be used in the next-to-last equation: 


BPN 1 GN LNXN 
(4) XN 1 一 一 一 一- 一. 
GaN 1N 1 


NowxNw andxw 1lareusedto findxN 2: 


PN 2 QQN2N IN 1 QN 2NXN 
(9) XN 2 二 一 一 一 一. 
GN 2N 2 
Once the values YN, ZN 1,...,Xk+l areknown,the general step is 


ZK CK1X) 
(0) 40 for 大 =N 1N 2 ...，1. 
CAKK 


The uniqueness of the solution is easy to see，The Nth equation implies that 
pN/aNN is the only bossible value of xzN. Then finite induction is used to establish 
that xN 1,XN 2,...，,Xlare unique. @ 


Example 3.12.。 Use back substitution to solve the linear system 
4xl 22 十 2x3 十 3x4 一 20 
2x2 十 7Tx3 4x4 一 7 
6x3 十 Sx4 一 4 
3x4 一 6. 
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Solving forx4 in the last equation yields 
X4 一 二 一 2. 


3 


Using x4 一 2inthe third equation, we obtain 





罗 4 SO2) 
3 一 一 0 
Nowx2 一 1andxzd4 三 2areusedtofindx2 inthe second equation: 


7 7( 了 十 402) 
= 一 一 一 一 一 = 4. 


Finally, xl is obtained using the first equation: 


20+1(4 2(0D1D 302) 
X 1 一 一 
4 
The condition that akk 天 0 is essential because equation (6) involves division 


by akk. If this requirement is not fulfilled, either no solution exists or infinitely Imany 
Solutions exist. 





3. [ 


Exampjle 3.13. Show 由 at there is no solution to the linear system 


4xl xx2 十 273 十 34 一 20 
0xzz 十 7x3 4044 一 7 

6x3 十 4 一 4 

3x4 三 6. 


(7) 


Using the last equation in (7), we must have x4 = 2, which is substituted into the second 
and third equations to obtain 


7xza 8= 7 


8 
人 ) 6x3 十 10 王 4， 


The first equation in (8) implies that x3 = 1/7, and the second equation implies that 
2x3 一 1，This contradiction leads to the conclusion that there is no solution to the lin- 
ear System (7). [| 


Example 3.14. Show that there are infinitely many solutions to 


4xl1 xx2 十 2x3 十 3 三 20 
0x2 十 7x3 十 0x4 一 7 

6x3 十 54 三 4 

3X4 一 6. 


(9) 
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Using the last equation in (9),， we must have x4 一 2, which is Substituted into the Second 
and third equations to get xz3 一” 1,， which checks out in both equations， But only two 
values x3 and x4 have been obtained from the second through fourth equations, and when 
they are Substituted into the first equation of (9), the resujt is 


(10) x2 一 4xl 16， 


which has infinitely many solutions; hence (9) has infinitely many solutions. 开 we choose a 
valueof xl in (10),thenthe value of xz2 is uniquely determined. For example, 让 we include 
the equation xl = 2 in the System (9), then from (10) we compute xy2 一 8. 时 


Theorem 3.4 states that the linear System 4 下 三 及, where 4is an N x N matnxX， 
has a unique solution if and only it det(4) 关 0. The following theorem states that 
if any entry on the main diagonal of an upper- or lower-triangular matrix is zero then 
det(4) = 0. Thus, by inspecting the coefhicient matrices in the previous three exam- 
ples, it is clear that the System in Example 3.12 has a unique solution, and the systems 
in Examples 3.13 and 3.14 do not have unique solutions， The proof of Theorem 3.6 
can be found in most introductory linear algebra textbooks， 


Theorem 3.6. Ifthe N x N matrix 4 = [aij]iseitherupper orlower triangular, then 
N 
(1 det(4) = al1022 …GNN 一 T [az 
. 1 一 1 


The value of the determinant for the coefficient matrix ip Example 3.12 is det 4 一 
4( 2)(6)(3) = 144. The values of the determinants of the coeffcient matrices in 
Example 3.13 and 3.14 are both 4(0)(6)(3) = 0， 

The following program w 记 Solve the upper-triangular system (1) by the method 
of back substitution, brovided ai 夭 0for 大 三 12,....,，N. 


Program 3.1 (Back Substitution)，To solve the upper-triangular system 4 五 一 玫 
by the method of back substitution. Proceed with the method only ifall the diagonal 
elements are nonzerfo. First compute YN = bpN/awN andthen use the rule 


RN 
PH1GkjA 





了 二 一 一 一 一 ftork=N 1 N 2 ...，1. 
CKK 
function X=backsub(A,B) ， 
%Input -Ais anDnxXxhnhupper-triangular nonsingular matTix 
包 -Bis annx1matrix 


YXkOutput - X is the solution to the 1inear System AX = B 
xyFind the Qimension of B and initialize 又 

D=1Length(B) ; 

X=zeros (有 ,1) ; 
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X(Cn)=BGn)VACGa ,na) ; 

for KX=n-1:-1:1 
X(k)=(B(K)-A(K,K+l1:D)*XCk+lin))VACGK,K) ; 

end 


了 xercises for Upper-triangular Linear Systems 


In Exercises 1 through 3, solve the upper-triangular system and find the value of the deter- 
minant of the coefcient matrix， 


1，3x1 2x2 十 X3 X4 一 8 2. SxY1 3xz 7x3 十 = 14 
4x2  X3 二 24 一 3 1lx2z 十 9x3 十 Sx4 一 22 

2x3 十 3x4 一 11 3x3 13x4= 11 

Sx4 一 19 7Tx4 王 14 


3，4x1 X2 十 2x3 十 2x4 好 = 4 
2xX2 十 0x3 十 2x4 十 7X5 一 0 
X3 Xx4 275 一 3 


2X4 X5 一 10 
3x5 = 6 
4. (3) Consider the two uppertriangular matrices 
al1 QI2 413 DPI 212 13 
4 一 |0 az az3 and 玫 =|0 pz? 2p23 
0 0 6033 0 0 pb33 


Show that their product C = 4B is also uppertriangular, 


(pb Let4and 刀 betwo N x Nuppertriangular matrices. Show that their product 
is also upper triangular. 


SSolve the lower-triangular System 4 天 = 玉 andfind det(4). 


2X1 一 6 
X1 十 4xX2 . 一 $ 
3x1 2xX2 2 一 4 


Xl 2x2 十 6x3 十 3x4 一 2 
6.、Solve the lower-triangular system 4 七 一 玉 andfind det(4). 


Sx1 一 10 
X1 十 3x2 一 4 
3x1 十 472 十 2x3 一 
Xl1 十 3x2 6x3 3X4 一 5 
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7. Show that back substitution requires N divisions, (N2 ”N)/2 multiplications, and 
(N2  N) /2 additions or subtractions. 瑟 int You can use the formiula 


Ad 
> KE 一 MOCUM 十 D/2. 
大 一 1 


Algorithms and Programs 
1，、Use Program 3.1 to solve the system 也 三 一 丸 where， 


cosGJ) 工 二 站 
已 = [jioxlio and 好 一 ; -1 


and 妃 = [oili]ioxl and il = tan(). 


2，Forward-supbstitution alegorithm，Alinear system 4 下 一 玉 iscalledlower triangular 
provided that wj = 0 when ij < jj Construct a program forsub, analogous to 


Program 3.1, to solve the following lowertriangular system、Rermark. This program 
will be used in Section 3.5， 


G11X1 二 已 

a21X1 十 02222 三 六 

CQ31X1 十 0322X2 十 Q33X3 一 03 
CN 11X1 十 CN 12X2 十 QN 1373 十 …- 十 QN 1N 1XN 1 = 一 pNv 1 


CNIXI 十 QN2X2 十 GN373 十 ,十 CNN LN 1 十 QNNXN 一 N 


3. Use forsub to solve the system 了 一 尼 , where 


十 了 了 二 记 


区 三 [1]20x20 and 局 三 | <) and 玫 王 [pi]2oxl and il = 六 


Gaussian Elimination and Pivoting 


In this section we develop a scheme for solving a general System 4 天 三 呈 of N 
equations and N unknowns， The goal is to construct an equivalent Upper-triangular 
System /不 二 了 that can be solved by the method of Section 3.3. 

Two linear systems of dimension N x N are said to be egzipalert provided that 
their solution sets are the same. Theorems from linear algebra show that when certain 
transformations are applied to a given system the solution sets do not change. 
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Theorem 3.7 (Elementary Transformations). The following operations applied to 
alinear System yield an equivalent System: 

(1]) interchanges: The order of two equations can be changed. 

(2) Scaling: Multiplying an equation by anonZzero constant. 


(3) Replacement: Anequation can be replaced by the Sum of itself and 
anonZzero multiple of any other equation， 


It is common to use (3) by replacing an equation with the difference of that equa- 
tion and a multiple of another equation，These concepts are illustrated in the next 
example. 


Example 3.1S， Find tpe parabolay 一 4 十 Bx 十 Cx2that passes through the three points 
(1 1), ( 2， 1, and (3, 1). 

For each point we obtain an equation relating the value of x to the value of >. The 
result is the linear System 


4 十 B+C= 1 at (1, 1) 
(4) 4 十 2B 十 4C= 1 at (2， 1]1) 
4 二 38 二 +9C= 1 at (3, ])， 


The variable 4 is eliminated from the second and third equations by subtracting the 
first equation from them, This is an application of the replacement transformation (3), and 
the resulting equivalent linear system is 


4 二 B3+ C= 1 
(G) 有 +3C= 2 
283 二 8C= 0. 


The variable B is eliminated from the third equation in ($) by Subtracting from it two times 
the Second equation. We arrive at the equivalent upper-triangular System: 


4+B+ C= 1 
(0) B+3C= 2 
2C = 一 4. 


The back-substitution algorithm is now used to find the coefficients C 王 4/2 一 2, 忆 = 
2 32 = 8and4=1 (8 2=7,andtheequationofthe parabola 1s 
7 了 一 7 8x 十 2x2. 国 


Lis efthicient to store all the coefficients of the linear system 4 下 一 吾 in an array 
of dimension N x (V + 1). The coefficients of B are stored in column N 二 1ofthe 
array (ie., QGKN+1 二 外)， Each row contains all the coefficients necessary to represent 
an equation in the linear System The atgmaertted maatrix is denoted [4| 召 ] and the 
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linear System ls represented as follows: 


ZI al2 QIN | 2 

0 402 …， 02N | D2 
(7) [4IB] = ， ， . 

aGNL GN2 …，QNN | ppN 


The system 4 天 = 及, with augmented matrix given in (7), can be Solved by per- 
forming row operations on the augmented matrix [4| 刀 ]. The variables xk are Place- 
holders for the coefficients and can be omitted until the end of the calculation. 


Theorem 3.8 (Elementary Row Operations)， The following operations applied to 
the augmented matrix (7) yield an equivalent linear system. 


(8) Interchanges: The order of two rows can be changed. 
(9)  Scaling: Multiplying a row by a nonzero constant. 


(10) Replacement: The row can be replaced by the sum of that row and 
anonzero multiple of any other rowi that is: 
TIOwr 一 IOwWr 1arp X IOWp: 


It is common to use (10) by replacing a row with the difference of that row and a 
multiple of another TOW. 


Definition 3.3 (Pivotj， The number arr in the coe 丛 cient matrix 4 that is used to 
eliminate akr，where 大 一 上 十 1r 十 2,...，N,iscalledthe rth piyrotazl elemerzft and 
the rth row is called the pivot row. 入 


The following example illustrates how to use the operations in Theorem 3.8 to 
obtain an equlvalent upper-triangular System V7 瑟 三 了 from alinear System 4 无 一刀 
where 4is an N x N matrix. 


Example 3.16. Express the following system in augmented matrix form and find an 
equivalent upper-triangular system and the solution， 


X1 十 2x2 十 X3 十 4x4 一 13 
2xX1 十 0x2 十 4x3 十 3x4 一 28 
4xl1 十 2xX2 十 2x3 十 4 一 20 
3x1 十 22 十 3x3 十 2x4 一 6. 


The augmented matrix is 


Pivot 一 1 2 1 4113 
11121 一 2 2043128 
mi3l 三 4 422 1|20 
Mi41 一 3 3 1 3 2|6 
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The first row is used to eliminate elements in the first column below the diagonal. 
We refer to the first row as the pivotal row and the element ai = 1 is called the pivotal 
element, The values mkl are the multiples of row 1 that are to be subtracted from row 大 for 
大 一 2, 3,4. The result after elimination is 


1 2 1 4 13 
pivot 一 0 4 2 5 2 
1132 一 1.5 0 6 2 15 32 
1142 一 1.73 0 7 6 14 45$ 


The second row is used to eliminate elements in the second column that lie below the 
diagonal. The second row is the pivotal row and the values 7mi2 are the multiples of row 2 
that are to be Subtracted from rowK for 大 = 3, 4. The result after elimination is 


1 2 1 41 13 
0 4 2 5 2 
pivot 一 0 0 3 7. 35$ 
143= 19|0 0 9%5 5.25|48.5 
Finally, the multiple m43 = 1.9of the third row is Subttacted from the fourth row, and 
the result is the upperT-triangular System 
1 2 1 全 1 
0 4 2 5 2 
(1 0 0 5 75| 35 
0 0 0 9|1 18 


The back-substitution algorithm can be used to solve (11), and we get 
X4 一 2， X3 一 人 4， xX2 一 |， X1l 一 3， 四 


The process described aboveis called Garssiarz ezizzatiox and mustbe modified 
so that it can be used in most circumstances. If ak 三 0, row cannot be used to 
eliminate the elements in column 大 , and rowK must be interchanged with some row 
below the diagonal to obtain a nonzero pivot element. If this cannot be done, then the 
coefficient matrix of the System of linear equations is nonsingujar, and the system does 
not have a unique solution， 


Theorem 3.9 (Gaussian Elimination with Back Substitutiom). If4isanN xN 
nonsingular matrix, then there exists a System 以 互 = 了 ,equivalentto 4 下 一 万, where 
V is an upper-triangular matrix with xiK 天 0. After D and 了 are constructed, back 
Substitution can be used to solve 芝 互 二 了 for 碟 . 
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Proor We will use the augmented matrix with 另 stored in column N 十 1: 


(D  ，(D) (1) (1 


Za 42 43 QIN | | af 
(1) (1) (1) (I) 
天 (D 
421 022 423 2N 2 CN+1 
(]) (]) (]) (U 
G C CQ 1 关 (1 
凡 素 二 |431 32 33 3N 3 | 一 2N+l | 一 也. 
1 1 1D) 上 (〈D) 
明史 号 


Then we will construct an equivalent Upper-triangular System 忆 下 一 了 : 
(>D vv(U (1D) (D) 


Za 02 43 QIN X1 41 N+1 
(2) (2) (2) (2) 
0 42 03 2N 2 422 N+1 
(3) (3) (3) 
DX=|0 0 3 … oaw| 53|1=|1aw+l| = 了 
(AN) (NW) 
0 0 0 aaNN| [2 ZN N+1 


Siep 7， Store the coefficients in the augmented matrix. The supberscript on aa Iaeans 
that this ls the first time that a number is stored in ljocation (r, c): 


(1 (]J) (I) (DU (1) 
1 42 43 QIN | 41N+l 

(1D) (D (1) (U) ( 革 
421 042 403 GoN |42N+l 

(D (JD (1) (1) 《1) 
1 4 0233 ”03N | 93N+i 

(0 (0 (| GD 

N1 ZN2 4N3 …”  GNN |2NN+l 


SIeP 2， 开 necessary, Switch rows So that aa 人) 关 0; then eliminate xl in Tows 2 
through N. Im this process, 7prt is the Imnultiple of row 1 that is Subtracted from row r. 


forr 三 2:N 
1 

mi aa 

ar 一 0; 

forc 一 2:N 二 1 

2 1 
da 人 一 C 名 Jr1 水 ai 

end 


end 
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The new elements are written aa to indicate that this ls the second time that &a 


number has been stored in the matrix at location (六 c). The result after step 2 js 


(2 (0D (]) (D 


61 42 4943 ”QIN |24IN+l 
(2) (2) (2) (2) 

0 4 0403 ON | ON+l 
(2) (2) (2) (2) 

0 aa 03 ”03N | 0N+l 
(2 (2) (2) (2) 

0 ZN2 GaN3 …，QNN | aNN+1 


Siep 了 I necessary，Switch the second row with some row below it So that 
422 关 0; then eliminate x2 in rows 3 through N. In this process, mar2 is the multi- 
ple ofrow 2 that is Subtracted from tow 上 . 


forr 一 3:AN 
2) ，(2 
mr 一 2/ a22); 
o -0 
forc 一 3:N 二 1 
3 2 2 
atz) 一 ao) J11zr2 米 aa 人 
end 
end 


The new elements are written aG) to indicate that this is the third time that a num- 


ber has been stored in the matrix at location (r, c). The result after step 3 is 


(1 GD ，(]D) (D) (D) 


1 42 43 ”aaIN 1451N+l 
(2) (2) (2) (2) 

0 oa2 643 ON | azN+l 
(3) (3) (3) 

0 0 4643 …， 4a3N | asw+l 
(3) (3) (3) 

0 0 CN3 …'， QNN | GNN+l 


Srep 尸 十 1，This is the general step. If necessary, Switch row P with some row 


beneath it so that aw 旬 和 关 0; then eliminate xp in Tows 疡 十 1 through N. Here mrp is 
the multiple of row P that is subtracted from row 六 . 


forr 一 忆 十 1:N 


mp 一 1o 多 
aa) 一 0 
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forc 王 PP+1:N+1 


(P+1 (P) 〈 疡 ) . 
ar ) = Cr 及 六 PP 沙 Cj ， 


end 
end 


The fnal result after xN 1 has been eliminated from row N is 


(D v() (1) (1) () 


1 02 43 ”QIN | 4N+i 
2) 0O) C) | _O) 

0 62 043 GON | 02N+l 
G) G) | _G) 

0 0 43 …' 03N | 0N+1 
(N) | (N) 

0 0 0 4aNRGNN+I 


The upper-triangularization process is now complete. 

Since 4 js nonsingular, when row operations are performed the successive matrices 
are also nonsingular. This guarantees that Ga 人 天 0foralKinthe construction process， 
Hence back substitution can be usedto solve V 丰 二 了 for, andthe theorem is prove. 


Pivoting to Avoid CO =10 


下 a 饭 一 0, row P cannot be used to eliminate the elements in column P below the 


main diagonal. It is necessary to find row K， where at 和 关 0andK > P,andthen in- 
terchange row P and rowK so that a nonzero pivot element is obtained. This process is 
called pivoting, and the criterion for deciding which row to choose is called a pivoting 


strategy，、The 1riyzal piyotzrtg Strategy js as follows. 开 多 天 0, do not Switch rows. 
下 a 色 一 0, locate the first row below p in which a 包 夭 0 and Switch rows 大 and 万. 


This will result in a new element at2) 夭 0, which is a nonzero bivot elementt. 
PP p 


Pivoting to Reduce Error 


Because the computer uses fxed-precision arithmetic, it is possible that a smajll error 
will be introduced each time that an arithmetic operation is performed, The following 
example illustrates how the use of the trivial pivoting strategy in Gaussian elimination 
can lead to significant error in the solution of a linear system of equations， 
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了 xample 3.17.。 The values xl 一 x2 一 1.000 are the solutions to 


1.133xi1 十 .281x2 = 6.414 


42) 24.14x1 ”1.210x2 一 22.93. 


Use four-digit arithmetic (see Exercises 0 and 7 in Section 1.3) and Gaussian elimination 
with trivial pivoting to fnd a computed approximate solution to the system. 

The multiple mm21 一 24.14/1.133 = 21.31 of row 1 is to be Subtracted from row 2 to 
obtain the uppertriangular system. Using four digits in the calculations, we obtain the new 
coefficients 


a 包 = 1210 21.31(5.28D)= 1.210 112.5= 113.7 
a 人 = 22.93 21.31(6.414) = 22.93 ”136.7 = 113.8. 


The computed upPer-triangular system is 


1.133x1 十 $.281x2 一 6.414 
113.7x2 一 113.8. 


Back substitution is used to computex2 王 113.8/( 113.7) = 1.001,andxl = (6.414 
3$.281(1.001))/(1.133) = (0.414 ” $.286)/(1.133) = 0.9950. 上 


The eror in the solution of the linear System (12) is due to the magnitude of the 
multiplier 1m21 三 21.31. In the next example the magnitude of the multiplier mz21l is 
reduced by first interchanging the first and second equations in the linear system (12) 
and then using the trivial pivoting strategy in Gaussian elimination to Solve the system. 


Example 3.18.， Use four-digit arithmetic and Gaussian elimination with trivial pivoting 
to solve the linear system 


24.14xl ”1.210x2 一 22.93 
1.133x1 十 S.281x2 = 6.414. 


Thbis time mm21 三 1.133/24.14 = 0.04693 is the multiple of row 1 that is to be subtracted 
from row 2. The new coefficients are 


a 饭 = 5.281 ”0.04693( 1.210) = 5.281 十 0.05679 = 5.338 
al = 6.414 ”0.04693(22.93) = 6.414 1.076 ”= 5.338. 


The computed upper-triangular System is 


24.14xl1 1.210x2 一 22.93 
5.338x2 一 5.338， 


Back Substitution js used to compute xz2 三 9.338/1S.338 = 1.000, and xi 王 (22.93 十 
1.210(1.000))/(24.14) = 1.000. 外 
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The purpose of a pivoting strategy is to move the entry of greatest magnitude to 
the main diagonajl and then use it to eliminate the remaining entries in the column. 下 
there is more than one nonzero element in column P that lies on or below the main 
diagonal, then there is a choice to determine which rows to interchange. The partiat 
Pipoing strategy, jllustrated in Example 3.18, is the most common one and is used in 
Program 3.2，TJo reduce the propagation of eror, it is suggested that one check the 
magnitude of all the elements in column P that lie on or below the main diagonal. 
Locate rowK in which the eljement that has the largest absolute value lies, that is， 


|akp| 一 max{lapp|， |ap+lp|， ,|aN 1 |avp}， 


and then Switch row P with Iow 大 过 上 > 已 Now, each of the multipliers marp for 
7 一 忆 十 1...,ANwilbeless than orequalto 1 in absolute value. This process w 训 
usually keep the relative magnitudes of the elements of the matrix 7 in Theorem 3.9 
the same as those in the original coefficient matrix 4. Usually, the choice of the larger 
pivot element in partial pivoting will result in a smajller error being propagated. 

In Section 3.5 we will fnd that it takes atotal of (4N3 十 9N2 7N) /6 arithmetic 
Operations to solve an N x N system. When N = 20, the total number of arithmetic 
operations that must be performed is 5910, and the propagation of error in the compu- 

tations could result in an erroneous answWer The technique of scaled partial pipotirag 
or equilibrating can be used to further reduce the effect of error propagation. In scaled 
partial pivoting we search al the elements in column P that lie on or below the main 
diagonal for the one that is largest relative to the entries in its row. First search rows 六 
through N for the largest element in magnitude in each fow, say sr: 


(13) Sr 一 Inaxflarp|, |arp+ll ,larvwll forr=p，Dp+1 ...，N. 


The pivotal row K is determined by finding 


(14) |akp| 一 max | |app| |ap+lp| |avp| | 
一 3 一 ，， .一 一 人- 
天 SP 3p+1 SN 


Now interchange row P and 太 unless p 一 上 .Again, this pivoting process is designed 
to keep the relative magnitudes of the elements in the matrix DZ in Theorem 3.9 the 
Same as those in the original coe 丛 cient matrix 4. 


Di conditioning 


Amatrix 4 is called 说 cozrdifioned 计 there exists a matrix 下 for whbich small pertur- 
bations in the coefficients of 4 or 召 will produce large changes 让 不 =4 1B8. The 
System 4 下 一 驴 is said to be ill conditioned when 4 is 记 conditioned. In this case， 
numerical Imethods for computing an approximate solution are prone to have more 
error, 

One circumstance involving il conditioning occurs when 4 is “nearly singular 
and the determinant of 4 is close to zero. 下 conditioning can also occur in systems 
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了 
1.2 
2x+37y7= 3.4 
1.0 
0.8 (0.8, 0.6) 





xx Figure 3.4 Aregion where two 
equations are“almost satished”. 


0.5 1.0 1.5 2.0 


of two equations when two lines are nearly parallel (or in three equations when three 
Planes are nearly parallel). A consequence of il conditioning is that substitution of 


erroneous values may appear to be genuine Solutions， For example, consider the two 
equations 


x 十 2y》 2.00=0 


14 
(5) 2x 十 3y 3.40 = 0. 


Substitution of xo = 1.00 and yo = 0.48 into these equations “almost produces zeros"”: 


1 十 2(0.48) 2.00=1.96 2.00= 0.04>0 
2 十 3(0.48) 3.40=3.44 3.40= 0.04 xs 0. 


Here the discrepancy from 0 is only 士 0.04. However the true solution to this lin- 
ear System ix 一 0.8 and y = 0.6, so the errors in the approximate solution are 
X xm=0.80 100= 0.20andy =0.60 0.48 = 0.12. Thus, merely sub- 
stituting values into a set of equations is not a reliable test for accuracy. The rhombus- 


shaped region Rin Figure 3.4 represents a Set where both equations in (1$) are“almost 
Satisfied : 


有 R=({cy):Ixz+27 200I<01 and |2z+3y7 3.40| < 0.21}. 


There are points in R that are far away from the solution point (0.8, 0.6) and yet 
Produce small values when substituted into the equations in (15). If it is suspected 
that a linear System is il conditioned, computations should be carried out in multiple- 
precision arithmetic. The interested reader should research the topic of condition num- 
ber of a matrix to get more information on this phenomenon. 

了 1 conditioning has more drastic consequences when several equations are in- 
volved，Consider the problem of finding the cubic polynomial y = cl1x3 十 czx2 十 
C3X 十 c4 thatpasses throughthe four points (2, 8), (3, 27), (4, 64),and ($, 125) (clearly， 
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?7 一 x3 is the desired cubic polynomial). In Chapter 5 we will introduce the method 
of least Squares. Applying the method of least squares to find the coefficients requires 
that the following linear System be solved: 


20,514 4,424 978 2241 | cl 20,514 
4,424 978 224 54|11cz | | 4424 
978 224 54 14|1c | 978 
224 354 14 4| 17zc4 224 


A compnuter that carried nine digits of precision was Used to compnute the coeffcients 
and obtained 


cl = 一 1.000004， cz 三 ”0.000038， ca = 0.000126， and  c4 = 0.000131. 


Althoughthis computation is close to the true solution, cl = 1 andc2z 一 c 一 c4 一 0,if 
Shows how easy it ls for error to creep into the solution. Furthermore, suppose that the 
coefficient dl 三 20,$14 in the upperleft corner of the coefficient matrix is changed 
to the vajlue 20,S15 and the perturbed system is solved. Values obtained with the same 
computer were 


cl = 0.042837，”c 一 3.73000， cs3 = 12.3928， and cd4 = 12.7500， 


which is a worthless answWer JI conditioning is not easy to detect，If the system is 
solved a second time with slightly perturbed coefficients and an answer that differs 
Significantly from the first one is discovered, then it is realized that 让 conditioning 


is present，Sensitivity analysis is a topic normally introduced in advanced numerical 
analysSis texts， 


MATITLAB 


In Program 3.2 the MAILAB statement [A B] is used to construct the augmented 
matrix for the linear System 4 天 王 妇 , and the max command is used to determine 
the pivot element in partial pivoting. Once the equivalent triangulated matrix [ZI 了 ] 
is obtained it is separated into Vand 了, and Program 3.1 is used to carry out back 
Substitution (backsub(U ,Y)). The use of these commands and processes is ilustrated 
in the folowing example. 


Exampjle 3.19， (a) Use MAILAB to constructthe augmented matrix forthe linear system 
in Example 3.16; (b) use the max command to find the element of greatest magnitude in the 
first column of the coef 丛 cient matrix 4; and (c) break the augmented matrix in (11) into 
the coe 丛 cient matrix UV and constant matrix yY of the upper-triangular system 了 7 瑟 = 了 . 
(a) 

>> A=[1214;2043;4221;-3132]; 

>> B=[13 28 20 6] ，; 

>> Aug=[A B] 
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Aug= 


心 情 
局 品 昌 
N 中 哺 
上 网 心 
名 品 基 


-31326 


(b) In the following MAILAB display, a is the element of greatest magnitude in the first 
column of A and j is the row number. 
>> [a,j]=max{fabs(A(C1:4,1)) 
a= 
4 
j= 
3 
(c) Let Augup = [ZI be the upper-triangular matrix in (11)， 
>> Augup=[121413;0 -42-52;00-5-7.5 -35;0 0 0 -9 -18] ; 
>> U=Augup(1:4,1:4) 
U= 
1.0000 2.0000 1.0000 4.0000 


0 -4.0000 2.0000 -5.0000 
0 0 -5.0000 -7.5000 
0 0 O -9.0000 
>> Y=AugupP(1:4,5) 
Y= 
13 
2 
-35 
-18 









Program 3.2 (Upper Triangularization Followed by Back Substitutiom). To 
construct the solution to 4 于 = 姻 , by firstreducing the augmented matrix [4| 瑟 ] to 
upper-triangular form and then performing back substitution. 


function X = Uptrbk(A,B) 


XInput - Ais anNxXxNDnonsingular matrix 
% -Bis anNX1matrix 
XoOutput - X is an N x 1 matrix containing the solution to AX=B. 
XInitialize X and the temporary storage matrix C 
IN NM]=size(A) ; 
X=zeros (N,1) ; 
C=zeros (1,N+t) ; 


XForm the augnented matrix:Aug= [AIB] 
Aug=[A B] ; 
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for P=1:N-1I 
YXPartial pivoting for column P 
[Y,j]=max(abs(Aug(P:N,P))); 
XInterchange row P and j 
C=Aug(P，:) ; 
Aug(P,:)=Aug(j+p-1，,:); 
Aug(j+p-1，,:)=C; 

if Aug(P,Pp)==0 
)A Was Singular. No unique SolLution:” 
break 

end 


XE1Limination Process for column P 
for XK=p+1l:TN 
m=Aug(Kk,P)VAug(P,P) ; 
Aug(k,Pp:N+1)=Aug(K,P:N+L)-mryaug(P,P:N+1L1) ; 
end 
end 


YXBack Substitution on [UIY] using Program 3.1 
X=backsub(Aug(1:N,1:N) ,Aug(1:N,N+1)) ; 


Exercises for Gaussian Elimination and Pivoting 





Jn Exercises 1] through 4 Show that 4 天 王 及 is equivalent to the upper-triangular System 
7X = 了 and find the solution. 


1 2x1 十 4x2 6r3 一 4 2X1 十 4x2 6xr3 一 4 
X1 十 $x2 十 3x3 一 10 3x2 十 6x3 一 12 

xX1 十 3xz 十 2x3 一 5 3x3 一 3 

2。 X1 十 2X2 十 6x3 一 7 XI 十 x2 十 6x3 一 7 
Xl1 十 2x2 十 9x3 一 2 3x2 十 1S$x3 一 9 

Xl 2x2 十 3x3 一 10 12x3 一 12 

3.。 2xl 2x2 十 Sx3 一 6 2xl 2x2? 十 Sx3 一 6 
2x1 十 3x2 十 X3 一 13 Sx2 4x3 一 7 了 


X1 十 4x2 4x3 一 3 0.9x3 王 1.8 

4。 Sxl1 十 2x2 23 一 SxX1 十 2x2 X3 一 工 
X1 十 0Ox2 十 3x3 0.4x2 十 2.8x3 一 4.8 

3x1 十 x2 十 6x3 一 17 10x3 = 10 


上 1 
《和 一 


S. Find the parabolay 一 4 十 Bx 十 Cx? that passes through (1, 4), (2, 7), and (3, 14). 
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6.Find the parabola y 一 4 十 Bx 十 Cx2 that Passes through (1, 6), (2, 5), and (3, 2). 


7.Find the cubic = 4 十 Bx 十 Cx2 十 Dx3 that passes through (0,0), (1, 1 (2,2)， 
and (3, 2). 


In Exercises 8 through 10, show that 4 基 一 有 is equivalent to the upper-triangular System 
有 一 Y and find the solution. 


8. 4x1 十 8x2 十 4x3 十 0x4 一 8 4x1 十 8xz 十 4x3 十 0x4= 8 
X1 十 Sx2 十 4x3 3x4 三 4 3x2 十 3x3 3x4 二 6 

Xl 十 4x2z 十 7xz3 十 2x4 一 10 4x3 十 4x4 一 12 

Xl 十 3xz 十 0x3 24 一 4 X4 一 2 

9. 2x1 十 4xz 4x3 十 0r4 一 12 2xX1 十 4x2? 4x3 十 0x4 一 12 
Xl 十 Sx2? 4Sx3 3k4 一 18 3x2? 3x3 3x4= 12 

2x1 十 3x2 十 X3 十 3x4 一 8 4X3 十 2x4 一 0 

Xl 十 4x2 2x3 十 2x4 一 8 3x4 三 6 

10. xl 二 2x2 十 0x3 X4 一 9 X1 十 2x2 十 0x3 xX4 一 9 
2X1 十 3X2 X3 十 0Ox4 一 9 X2 X3 二 24 一 9 
0Oxl 十 4x2z 十 2x3 9x4 一 20 2X3 十 3x4 一 10 
SX1 十 Sxz 十 2X3 444 一 32 1.Sx4 一 3 


11，Find the solution to the following linear system， 


X1 十 2x2 一 7 
2x1 十 3x2 3 一 9 
4x2 十 2x3 十 3x4 一 10 

2x3 4x4 一 12 


12， Find the solution to the following linear system. 


X1 十 X2 一 5 
2X1 X2 十 3X3 一 9 
3x2 4x3 十 2x4 一 19 

2x3 十 6x4 一 2 


13. IThe Rockmore Corp. is considering the purchase of a new compnuter and will choose 
either the DoGood 174 or the MightDo 11. They test both computers” ability to Solve 
the linear System 


34x 十 $Sgy 21=0 
55Sx 十 89y 34= 0. 


The DoGood 174 computer givesx 一 0.11 andy 三 0.4$,andiits check foraccuracy 


加 
- 


14. 


1S. 
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is foung by substitution: 


34( 0.11) 十 55(0.43) 21 = 0.01 
SS( 0.11) 十 89(0.4$) 34 = 0.00. 


The MightDo 11 compnuter givesx 一 0.99andy = 1.01, and its check for accuracy 
is found by substitution': 


34( 0.99) 十 55(1.01) 21 = 0.89 
335( 0.99) 十 89(1.01) 34 = 1.44. 


Which computer gave the better answer? Why? 


Solve the following linear systems using (iD) Gaussian elimination with partial pivot- 
ing, and (ii) Gaussian elimination with scaled partial pivoting. 


(a) 2x1 3x2 十 100x3 一 1 (bj) xl 十 20x2 X3 十 0.001x4 一 0 


xX1 十 10x2 0.001x3 三 0 2xX1 Sx2 十 30x3 0.1x4 王 1 
3x1 100x2 十 0.01x3 一 0 xl 十 322 100x3 10x4 三 0 
2x1l1 100x> 2X3 十 X4 一 0 


The Hilbert matrix is a classical il-conditioned matrix and small changes in its coef- 

ficients will produce a large change in the solution to the perturbed system. 

(a) Find the exact solution of 4 革 一 下 (leave all numbers as fractions and do exact 
arithmetic) using the Hilbert matrix of dimension 4 x 4: 


1 1 1 
1 瑟 子 了 
1 1 1 1 0 
2 3 4 

和 瘦 一 ， 田 一 

1 1 1 1 0 
3 4 5 6 0 
1 1 1 1 
4 3 0 7 


(b) Now solve 4 天 一 Busing four-digit rounding arithmetic: 


1.0000 0.5000 0.3333 0.2500 
0.5000 0.3333 0.2500 0.2000 | 
0.3333 ”0.2500 0.2000 0.1667 | 
0.2500 0.2000 0.1667 0.1429 


必 一 


之 尼 握 一 


ANote, The coefficient matrix in part (b) is an approximation to the coefticient 
matrix in part (ay). 
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人 Algorithms and Programs 





1.、Many applications involve matrices with many zeros，Of Practical importance are 
1ridiagorial yyste11ts (See Exercises 11 and 12) of the form 


dIxXl 十 cl1X2 一 六 1 
CHX1I 十 dx2 十 Co2X3 一 > 
02X2 十 G3X3 十 C3X4 一 2 


QN 2XN 2 十 CN IIXN 1 十 CN LIXN 一 bpN 1 
CN IZN 1 十 CNvXN = DN， 


Construct a program that will solve a tridiagonal system. You may assume that row 
interchanges are not needed and that rowK can be used to eliminate xk in row 大 十 1 


2. Use Program 3.2 to find the sixth-degree polynomial y = al 十 a2xz 十 a3x2 十 a4x3 十 
a5x4 十 a6x5 十 a7x6 that passes through (0, 1)，(1, 3)，(2, 2)，(3, D)，(4, 3)，(S, 2)， 
and (6, 1). Use the Plot command to plot the polynomial and the given points on the 
same graph. Explain any discrepancies in your graph. 

3.， Use Program 3.2 to solve the linear system 4 天 一 下 ,where 4 一 [oj]wxN and 
dj 一 订 Land 妇 =[bojwxiwherebl 一 Nandpl=iy 20 1Dfori>2. 
Use N = 3,7,and 11. The exact solution is 于 一 丰 .1 ]] Explain any 
deviations from the exact solution. 


4，Construct aprogram that changes the pivoting strategy in Program 3.2 to scaled partial 
pivoting. 


SUse your scaled partial pivoting program from Problem 4 to solve the system given 
in Problem 3 for N = 11. Explain any improvements in the solutions. 

6. Modify Program 3.2 so that it will efciently solve M 1linear Systems with the same 
coe 任 cient matrix 4 but different column matrices 妨 . The M linear systems look like 


4 环 1 一 另 1， 4X2 一 ?， .，， 人 4 下 NM 一 吾 1Mf， 


7. The following discussion is presented for matrices of dimension 3 x 3, but the con- 
cepts apply to matrices of dimension N x N. If 4 is nonsingular,then 4 1exists and 
44 1 = 了 Let Cl Ca,and Ca3 be the columns of 4 1 and 羽 1, 玖 2，and 互 3 be the 
columns of 7. The equation 44 1 = 7 can be represented as 


入 [Ci C2 C3] 一 [8 五 2 巨 3] 。 
This matrix Product is equivalent to the three linear systems 


4C1 = 五 1， 4C2 一 五 ?， and 4C3 一 万 3. 
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Thus finding 4 1 is equivalent to solving the three linear systems. 

Using Program 3.2 of your Program from Problem 6, find the inverse of each of the 
following matrices. Check your answer by compnuting the product 44 1 and also by 
using the command inv(A). Explain any differences. 


， 16 10 ?40 140 
3 》 5 四 | 120 1200 2700 1680 
() 1 1 240 ”2700 ”6480 ”4200 


140 ”1680 ”4200 2800 


Triangular Factorization 


In Section 3.3 we Saw how easy it is to solve an Uppertriangular System， Now we 
introduce the concept of factorization of a given matrix 4 into the product of a lower- 
triangular matrix 克 that has 1's along the main diagonal and an upper-triangular ma- 
tx UV with nonzero diagonal elements. For ease of notation we illustrate the concepts 


with matrices of dimensioa 4 x 4, but they apply to an arbitrary system of dimension 
N xAN. 


Definition 3.4， The nonsingular matrix 4 has a trianzgruicr jactorizatiom 让 it can 
be expressed as the product of a lower-triangular matrix 忆 and an upper-triangular 


matrix 也 : 
(]) 4 一 工 D7. 


In matrix form, this js written as 


al1 al2 413 414 1 0 0 0 M2 x3 14 
4a21 aq2 423 404| | ma2l 1 0 0 0 122 1823 024 
4d31 632 033 6034| |m3l m3 1 0||10 0 1 24 
Q41 0G42 043 044 1a241 1a42 Jp43 1 0 0 0 ax44 


全 


The condition that 4 is nonsingular implies that x 上 f 头 0 for all 大 The notation 
for the entries in 也 is 六 ii， and the reason for the choice of mm; jinstead of 1 will be 
pointed out Soon， 


Solution of a Linear System 


Suppose that the coeffcient matrix 4 for the linear system 4 天 一 妨 has a triangular 
factorization (1); then the solution to 


(2) 也 世 和 一 天 
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can be obtained by defining 了 = V7AX and then solving two Systems: 


(3) first solveZ7 一 届 for 了 ; then solve 也 五 二 了 了 for 大. 
In equation form, we must first solve the lower-triangular system 
y1 一 六 1 
Gd m21y1 十 六 一 
31y71 十 132y2 十 咏 一 加 


1141y1 十 1142y2 十 1143y3 十 y4 三 b4 


to obtain y1, y)2，y3, and y4 and use them in solving the upper-triangular System 


M11X1 十 &12X2 十 UL13X3 十 1I4X4 一 y1 
122X2 十 UL23X3 十 24X4 一 y2 

33X3 十 34X4 一 73 

MU44X4 一 区 4. 


G) 


卫 xample 3.20， Solve 
X1 十 2x2 十 4x3 十 14 一 21 
2x1 十 8x2z 十 6x3 十 4x4 一 S2 
3x1i 十 10xz 十 8x3 十 8x4 一 79 
4x1 十 12x2 十 10x3 十 6x4 = 82. 


Use the triangular factorization method and the fact that 


1] 2 4 1 1 0 0 0 1 2 4 
4 一 2 8 64| |2100|10 4 2 
13 10 8 8| 13 11 0I10 0 2 
4 12 10 6 4 12 1|I00 0 
Use the forward-substitution method to solve 上 7 = 妇 : 
y1 一 21 
271 十 思 一 S2 
(0) 
371 十 2 十 3 一 79 


471 十 办 十 2?3 十 中 一 82. 
Compute the values 7J1 = 21,X2 = 5$2 2(C21) = 10,y =79 


3(21) 


10 = 6, and 


M=82 4(C21) 10 2(0) 王 24,or7Y = [21 10 6 24] Next write the System 


忆 7 下 一 了 : 
Xl 十 2x2 十 473 十 X4 一 21 
4xr2 2783 十 2x4 一 10 
2x73 十 3x4 一 6 
6x4 一 24. 


(7) 
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Now use back substitution and compute the solution x4 = 24/( 0) 三 4,x3 一 (6 
3(4))/( 2)=3,xz2 =(10 2(4) 十 2(3))/4=2,andxl=21 4 4G3) 20C)=1,or 
X=[1 2 3 4 加 


Triangujar Factorization 


We now discuss how to obtain the triangular factorization. If row interchanges are not 
necessary When using Gaussian elimination, the multipliers mij are the subdiagonal 
entries in 世 . 


Example 3.21. Use Gaussian elimination to construct the triangular factorization of the 
matriX 


4 3 T 
4 一 2 4 5 
] 2 6 


The matrix 和 will be constructed from an identity matrix placed at the left， For each row 
operation used to construct the uppertriangular matrix, the multipliers mij will be Put in 
their proper Places at the left. Start with 


1 0 0 4 3 1 
4=|0 1 0 2 4 5 
0 0 1 1 2 6 


Row lis used to eliminate the elements of 4 in column 1 below al1. The multiples mma2l 一 
0.5 and 131 一 0.25 of row 1 are subtracted from rows 2 and 3, respectively，These 
multipliers are put in the matrix at the left and the result is 


1 0 0|114 3 1 
4=| 053 1 0110 2. 4.5 
0.23 0 1110 1.23 6.25 


Row 2is used to eliminate the elements of 4 in column 2 below a22. The mnultiple m32 二 
0.5 of the second row is subtracted from row 3, and the multiplier is entered in the matrix 
at the left and we have the desired triangular factorization of 4. 


1 0 0|114 3 1 
(8) 人 = | 0.5 1 0|1|10 25 4.5 


0.253 05 1|10 0 8.5 四 


Theorem 3.10 (Direct Factorization 4 = 元 0. No Row Interchanges). Suppose 
that Gaussian elimination, without row interchanges, can be successfully performed to 
Solve the general linear System 4 = 玉 . Then the matrix 4 can be factored as the 
Product of a lower-triangular matrix 艺 and an upper-triangular matrix 7 忆 7: 


4 一 工 以 ， 
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Furthermore, 也 can be constructed to have ls on its diagonal and U will have nonzero 
diagonal elements. After fnding 世 and 局, the solution Xis computed in two Steps: 

1. Solve 工 U = 了 foryY using forward substitution. 

2. Solve 以 下 = 了 for 互 using back substitution. 


Proof We will show that，when the Gaussian elimination process is followed and 
尼 is stored in column N 十 1 of tbe augmented matrix，the result after the upper- 
triangularization step is the equivalent upper-triangular System 芝 大 = 了 . The matrices 
也 , 忆 7, 有 and7 will have the form 


(JU) 

1 0 0 0 aiN+1 

1121 1 0 .… 0 a 人 1 

了 一 11131 732 1 … 0 男 一 a 亿 1 
NI 7mN2 1IN3 (V) 


ZN N+1l 


人 at au (D 


Za11 412 41 Q1N 41 N+1 
(2) (2)》 (2) (2) 

0 ad2 403 GON 42 N+1 
G) G) (G3) 

U=|0 0 3 … asN |， 了 = | 43N+1l 
《(N) (N) 

0 0 0 9NN 4NN+1 


Remark. To find just 工 and UV ,the (N 十 1l)st column is not needed. 
Step 7 Store the coefficients in the augmented matrix，The superscript on C 纪 
means thbat this is the first time that a number is stored in location (r, c). 


(1) (1D) (D (TD 《1 
QI 42 013 


4IN | G1N+1 
(人 CD  (D (]) (1 
21 02 0423 … 42N | 02N+l 
GD 0  (D (D (D 
Cl1 4432 043 ”03N | 93N+l 
CD GD  (D O | 
Cvl QGN2 4N3 …” QQNN |QGNN+l 


Step 2 了 Eliminate xl in rows 2 through N and store the multiplier mr1，used to 
eliminate xl in row r, in the matrix at location (r,， 1). 
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forr 一 2:N 
1 1 
mrl 一 ar/ali ; 
Orl 一 1117r1， 


forc 一 2:N 二 1 


2 1 1 
Ca 一 a 岂 及]1 玉 al; 


end 
end 
The new elements are Written 多 to indicate that this is the second time that 8 
number has been stored in the matrix at location (r, c). The result after step 2 is 


(1) (  v(D (1) (1) 


QI1 42 43 ”atN | 4N+l 
(2) (2) (2) (2) 
1t21 02 0423 0N | 42N+ 
(2) (2) (2) (2) 
Pt31 032 43 ”03N | 43N+l 
CO) 0) oO | Oo) 
1INI CN2 CN3 … ”4NN |4NN+l 


Step 3，Eliminate x2 in rows 3 through N and store the multiplier mr2，used to 
eliminate x? in Tow r, in the matrix at location (7, 2)， 


forr 三 3:N 
2) ， (2 
mar2 一 002 1a22 ; 
Cr2 一 1107r2， 
forc 王 3;:N+l 
3 2 2 
a 色 一 aa 人 Jr2 水 a0; 
end 
end 


The new elements are written aa) to indicate that this is the third time that a num- 


ber has been stored in the matrix at the location (r, C). 


(U (1) 《]) (1) (] 

4 402 03 ”QIN | 424IN+l 
(2) 《2) (2) (2) 

1121 602 023 0oN |942N+l 
3 3 3 

131 。 732 0 和 53 机 < 这 al 
: : 

maNl mnN2 aa | aa 


Step 忆 十 1. This is the general step, Eliminate xp in TOws 己 十 1through N and 
store the multipliers at the location (”, 站)， 
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forr =DP 二 1:N 


mp 一 a 多 1o: 
CQrp 一 11Irp， 
forc=P+1:N+l 
at 一 at marpya 多 ); 
end 
end 


The fnal result after xN 1 has been eliminated form row N is 


() CD (0D | 


(1) 
al 912 413 aiN | SI1N+1l 
(2) (2) (2) (2) 
12l 4 0023 ”42N | 42N+i 
(3) (3) (3) 
17131 7132 033 ”4N | 93N+l 
(N) (N) 
NI PN2 PN3 ”4NN | ZNN+i 


The upper-triangular process is now complete. Notice that one array is usedto store 
the elements of both 环 and 避 . TIJhe ls of 世 are not stored, nor are the 0's of 也 and 
7 that lie above and below the diagonal, respectively. Only the essential coefcients 
needed to reconstruct 二 and Z are stored! 

We mnust how verify that the product 了 UV 三 4， Suppose that 刀 = LU and 
consider the case when r < c. Then dv is 


(9) 坟 c 一 1marlg0) 十 1ar24 人 2 十 … :十 了 rr 1af 1 十 aa) 


Using the replacement equations in steps 1 through P 十 1 = ~, we obtain the following 
substitutions: 


| 
mriatD aaD)， 


2 
mpaa2 aag) 
〈10) 


人 rr ] 


一 rer 1U (站 
r tc 二 rc Grc “ 


172rr 1Q 
When the substitutions in (10) are used in (9), the result is 
de=a oa@+ag aa+ + +ag = 


The other case, > c, is Similar to prove. e@ 
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Computational Complexity 


The process for triangularizing is the same for both the Gaussian elimination and tri- 
angular factorization methods.， We can count the operations 这 we look at the first N 
columns of the augmented matrix in Theorem 3.10. The outer loop of step PP 十 1 re- 
quiresN PP=N (+1UD+1ldivisions to compnute the multipliers mrp. Inside the 
loops, but for the first N columns only, atotal of (W PIN pp)multiplications and 
the same number of subtractions are required to compute the new row elements aa 人 十， 
This process is carried out for 忆 = 1 2,...,N 1.Thusthetriangular factorization 
portion of 4 一 UV requires 





N 1 3 

AN 

(11) 》 (VW PNV PP+Dl)= multipjications and divisions， 

P=1 
and 
N 1 3 2 

2N 3N 和 

(12) 》 (NW PN 和 门 三 人 Subtractions， 


P=1 6 


To establish (11), we use the summation formulas 


即 4 6 


打 邓 
= ad PXTDCNTD， 
Kk=1 k 一 1 


Using the change of variables 上 三 N PP, werewrite (11) as 


AN 1 N 1 N 1 
>IN PN p+D=>N Dm+》 ON 门 ? 
1 


一 1 2 一 P=1 


AN 1 N 1 
= 》 大 十 》， 好 
到 一 1 天 一 1 
(NW DN (ON DODCN DT 
= -一 一 一 十 -一 一 
2 6 
N3 AN 
3 


Once the triangular factorization 4 = 克 V has been obtained, the solution to the 
lowertriangular system Z7 一 妨 will require 0 十 1+ ,+N 1=(N2 NA/2 
Imultiplications and subtractions; no divisions are required because the diagonal ele- 
Iments of 忆 are 1"S. Then the solution of the upper-triangular system V7 瑟 = 了 requires 
1+2 二 +N=(Nz 二 N)/2 multiplications and divisions and (NM? N)/2sub- 
tractions. Therefore, finding the solution to 元 V 互 一 万 requires 





N2 multiplications and divisions, and N2 。”N subtractions. 
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We see that the bulk of the calculations lies in the triangularization portion of the 
solution，If the linear System js to be Solved many times，with the same coefficient 
matrix 4 but with different column matrices 如, it is not necessary to triangularize the 
matrix each time ithe factors are Saved. This is the reason the triangujlar factorization 
Imethod is usually chosen over the elimination method，However if only one linear 
System is Solved, the two methods are the same, except that the triangular factorization 
method stores the multipliers. 


Permutation Matrices 


The 4 = 工 7 factorization in Theorem 3.10 assumes that there are no row inter- 
changes，LIt is possible that a nonsingular matrix 4 cannot be directiy factored as 
4 一 世 避 . 


了 Example 3.22， Show that the following matrix cannot be directly factored as 4 一 世 77: 
1 2 6 

4=| 4 8 

23 5 


Suppose that 4 has a direct factorization 亏 V; then 


1 2 6 1 0 0 LIi1 MI2 MI3 
(13) 4 8 1T | = 三 |mz2l 0 0 rzr22 7123 
2 3 和 ] 1131 132 1] 0 0 733 


The matrices 世 and V onthe right-hand side of(13) can be multiplied and each element 
of the product compared with the corresponding element of the matrix 4，JIn the first 
column, 1 三 lxwll, then 4 一 M21U11 一 凡 21，and finally 2 一 131U1L 一 mm31，In 
the second column, 2 一 lxl2, then 8 一 m2112 一 (4)(2) 十 22 implies that v22 一 0， 
and finally 3 一 Mm31u12 十 Mi32U22 一 ( 2)(2) 十 132(0) 一 4, which is a contradiction， 
Therefore, 4 does not have a 工 V factorization. 国 


A permnutation of the first N positive integers 1 2,...,Nis an arrangementKl, 怠 ， 
.….,KN ofthese integers in a definite order Forexample 1,4,2,3, Sis apermutation of 
the five integers 1, 2, 3, 4, $. The standard base vectors 五 ; = [00 ……. 0710.…… 0], 
for 一 1 2, ...,N,areused in the next definition. 


Definition 3.S， An N x N perzautatiorz miatrix Pis amatrix with precisely one entry 
whose value is 1 in each cotumn and row, and all of whose other entries are 0. The 
Iows of Pare a permnutation of the rows of the identity matnix and can be written as 


(14) P=[E4 ZE .有 ]. 
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The elements of 尼 一 [ 疡 : j have the fornma 


| 了 = 后， 
妨 一 0 otherwise. 


For example, the following 4 x 4 matrix is a permutation matrix， 


0 1 0 0 
1 00 0 

(15) P=|0001|=[B 本 下 肋 ]， 和 
00 1 0 

Theorem 3.11. Suppose that 疡 一 [E4， BE， .…. 五] is a permutation matrix. 


The product P4 is a new matrix whose rows consist of the rows of 4 rearranged in 
the order rowil 4, rowb 4,，. ,TOWkN 人 4， 


Example 3.23， Let4bea4x4matrix and let 忆 be the permutation matrix given in (15); 
then 情 4 is the matrix whose rows consist of the rows of 4 rearranged in the order row2 4， 
TOwW1 4, TOw4 4, TOwW3 4. 

Computing the product we have 


0 1 00|1a aa al3 al4 G21 422 423  G24 
1000|lla az oa3 ad4| _ 1a az2 aa3 al4 
0 0.01||al az 03 a34| jadl ad a4 a44 
0 0 1 0|La4 ad aq a44 031 032 933 034 四 


Theorem 3.12.I P is a permutation matrix, then it is nonsingular and 己 1 一 忆 . 


Theorem 3.13. I 工 4 is a nonsingular matrix, then there exists a permutation matrix 
下 sothat 尼 4 has atriangular factorization 


(10) 疡 4 一 工 尽 . 
The proofs can be found in advanced linear algebra texts. 


Example 3.24， Ifrows 2 and 3 of the matrix in Example 3.22 are interchanged, then the 
resulting matrix 尼 4 has atriangular factorization. 

The permutation matrix that switchesrows2 and3is 书 一 [已 五 五 ?] Comput- 
ing the product 忆 4, we obtain 


1 0 0 1 2 6 1 2 6 
PA4=|0 0 1 4 8 1I|=| 23 5 
0 1 0 23 5 48 1 
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Now Gaussian elimination without row interchanges can be used: 


pivot 一 1 2 6 
121 一 2 2 3 4 
11131 一 4 4 8 


After xz has been eliminated ffom column 2, row 3, we have 


1 2 6 
pivot 一 |0 7 17 | = 忆 ， 
ma32=0 |10 0 2 


了 Extending the Gaussian Elimination Process 


The following theorem is an extension of Theorem 3.10，which includes the cases 
when row interchanges are required. Thus triangular factorization can be used to find 
the solution to any linear system 4 在 = , where 4 is nonsingular. 


Theorem 3.14 (Indirect Factorization: P4 = 工 7)， Let 4 be agiven N x N 
matrix. Assume that Gaussian elimination can be performed successfully to solve the 
general lineat System 4 下 一 允 , but that row interchanges are required，Then there 
exists a permutation Imatrix 忆 So that the product 己 4 can be factored as the product 
of a lowertriangular matrix 了 and an upper-triangular matrix 也 : 


三 4 一 世 忆 7 


Furthermore, 了 can be constructed to have ls on its main diagonal and V will have 


nonzero diagonal elements, The solution 夺 is found in four steps; 


1. Construct the matrices 艺 , U , and 己 . 

2. Compnute the column vector 疡 史 . 

3. Solve 了 7 了 = 忆 呈 for 了 using forward substitution. 
4. Soltve U 王 = 了 for 瑟 using back substitution. 


RermarKk. Suppose that 4 七 一 五 is tobe solvedforafixed matrix 4 and several differ- 
ent column matrices 刃 . Then step ] is performed only once and steps 2 through 4 are 
used to find the solution 在 that corresponds to 妃 . Steps 2 through 4 are a computation- 
ally efficient way to construct the solution 不 and require O(N2) operations instead of 
the O(N3) operations required by Gaussian elimination. 


六 
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MATLAB 


The MATLAB command [L,U,P]=1LuUCA) creates the lower-triangular matrix 也, te 
Upper-triangular matrix Z (from the triangular factorization of 4), and the permutation 
matrix 严 from Theorem 3.14. 


Example 3.2S， Use the MAILAB command [LL,U,P]=1u(CA) on the matrix 4 in Ex- 
ample 3.22. Verify that 4 = 尼 14U (equivalent to showing that P4 一 工 刀 )， 


>>A=[126 ;48 -1;-23 -5]; 
>>[L,U,P]=1lu(A) 


工 = 
1.0000 0 0 
-0.5000 1.0000 0 
0.2500 0 1 .0000 
TU= 
4.0000 8.0000 -1.0000 
0 7.0000 4.5000 
0 0 6.2500 
P= 
OO0 
0 0 1 
100 
>>inVv(P)*LxU 
1 26 
4 8 -1 
-235 站 


As previously indicated the triangular factorization method is often chosen overthe 
elimination method. In addition, it is used in the inv(A) and det(A) commands in 
MATLAB. Forexample, from the study of linear algebra we know that the determinant 
of a nonsingular matrix 4 equals ( 1)9 detV, where V is the upper-triangular matrix 
from the triangular factorizationof 4 andg is the number of row interchanges required 
to obtain 忆 from the identity matrix 7、Since 7 is an uppertriangular matrix，we 
know that the determinant of V is just the product of the elements on its main diagonal 
(ITheorem 3.6)，The reader should verify in Example 3.25 that; det(4) = 175 一 
( 1D20175) = ( 了 2det(D). 

The following Program implements the process described in the proof of Theo- 
rem 3.10. It is an extension of Program 3.2 and uses partial pivoting. The interchang- 
ing of rows due to partial pivoting is recorded in the matrix 尺 . The matrix 尺 is then 
used in the forward substitution step to find the matrix 了 . 
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Program 3.3 (P4 = 工 U: Factorization with Pivoting)。 To construct the solu- 


tion to the linear system 4 大 一 吾 , where 4 is anonsingular matrix. 





function X = lufact(A,B) 


%Input 一 Ais anNXNDmatrix 
六 -Bis anNX ITILmatrix 
%Output -~ X is an N X 1 mattrix containing the solution to AX = 8 


%Initialize X，Y，the temporary storage matrix C，and the row 
% Permutation information matrix 有 R 
[N,N=size(A) ， 
X=zeros(N,1) ; 
Y=zeros(N,1) ; 
C=zeros(1,N) ; 
R=Ti:N， 
for P=1:N-1 
hFind the pivot row for column P 
[maxl ,jj=nax(abs(ACP:N,P))) ; 
XInterchange row P and jj 
C=A(CP，,:); 
AGP，,:)=A(Cj+p-1，:); 
A(j+p-1,:)=C; 
dq=R(CP) ; 
R(CP)=R(j+p-1) ; 
R(j+p-1)=di 
if A(P,P)== 
'"A is singular. No unique solution， 
bzreak 
end 


%Calculate multiplier and Place in Subdiagonal Portion of 入 
for K=p+1l:N 
mult=A(xk,p)/ACP,P) ; 
AGk,p) = mult; 
A(Ck,pP+l:N)=AGK,p+1:N)-mult+rA(pP,Pp+l1:N); 
end 
end 
%Solve for 了 
Y(C1) = B(R(C1)); 
for Kk=2:N 
Y(k)= B(R(k))-A(Gk,1:k-1)*xY(C1:K-1) ; 
end 
%hSolve for X 
XCN)=YCN)VACN,N) ; 
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for KK=N-t:-1:1 
X(k)=(Y(k)-A(k,k+1:N)*X(kt+t1:N))VACGK,K) ; 
end 


卫 xercises for Triangular Factorization 
Ce | 


1. Solve Z 了 = 吾 , UV 下 = 了 ,and verify that 有 = 4X for(a) 有 =[ 4 10 5 and 
(o) 召 王 [20 49 32] ,where4= 工 Dis 


2 4 6 1 0 0lr24 6 
15 3|=|12 1 0||o3 6|. 
13 2 1/2 13 1||00 3 


2. Solve ZLY 一 已,U 丰 = 了 ,and verify that 妃 一 4Efora) 有 =[7 2 10] and 
(也 =[23 35 7] ,where4 一 LUis 


1 1 6 1 00|l1L1 1 6 
1 2 9|=| 1 1 0|1|0 3 |. 
下 
3. Find the triangular factorization 4 = 艺 V forthe matrices 
SS 2 1 10 3 
(3) 1 0 3 (D) 3 1 6 
| 3 1 | | 5 2 
4. Find the triangular factorization 4 = 工 V for the matrices 
4 2 1 1 2 7 
(al) |2 SS 2 bbD) |4 2 1 
1 2 7 2 SS 2 


S. Solve L7 三 有 ,VE = 了 ,and verify that 召 = 4X for(a) 瑟 = [8 4 10 4] 
and (b) 妃 二 [28 13 23 4]' ,where 4 一 大 Di 


484 0 10 001[[484 0 
15 4 3| -| 1 00llo33 3 
1 4 7 2| | 于 打 10|o004 4 
130 2 放下 Ilooo0 1 


6. Find the triangular factorization 4 = 也 7V forthe matrix 


Lo Cn IO 一 
已 和 一 一 
iD 二 nn 局 
修 忆 巴 上 


7. Establish the formuja in (12). 


1S4 


1 
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。Show that a triangular factorization is unique in the following sense: If 4 is nonsin- 


gular and ZL1U1 一 4 三 和 272,thenZ1l 三 和 and 了 li 一 了 >， 


。Prove the caser > catthe end ofTheorem 3.10. 
10. 


(a) ”Verify Theorem 3.12 by showing that PP' = 了 = PPforthe permutation 
InatriX 


0 0 
0 0 
0 1 
1 0 


(pb) Prove Theorem 3.12， 囊 nt Use the definition of matrix multiplication and the 
fact that each row and column of 尼 and P' contains exactly one 1 


Prove that the inverse of a nonsingular N x N uppertriangular matrix is an upper- 
triangular matrix， 


Algorithms and Programs 


ee CI | 


1 


Use Program 3.3 to solve the system 4 天 = 妨 , where 


人 一 


妇 ww 记 一 


1 3 5 
2 1 3 
0 0 2 
2 60 3 


Use the [L,U,P]1=1u(A) command in MATILAB to check your answer. 


。Use Program 3.3 to solve the linear system 4 蕊 = 用 ,where 4 = [ai]wxN and 


叫 一 训 下 and 瑟 =[br]Nxl wherebl 王 Nandbi=iy2/06 lfori>2. 
Use N = 3,7, and 11， The exact solution is 下 = [1 1 ... 1 1 Explain any 
deviations from the exact solution 


， Modify Program 3.3 so that it will compute 4 1 by repeatedly solving N linear sys- 


temas 


4C7J 一 瑟 JJ for /=1，2，..,，N. 
Then 


and 
41=[cCi C2 .….， Cn]. 


Make sure that you compute the 二 77 factorization only once! 
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Figure 3.S ”The electrical network 
for Exercise 4. 


Ra6 


4. Kirchoff's voltage law says that the sum of the voltage drops around any closed path 
in the network in a given direction is zero. When this principle is applied to the circuit 
shown in Figure 3.9, we obtain the following linear System of equations: 


( 及 1 十 Ra3 十 民 4) 十 民 3 万 十 R403 一 五 1 
(17) 有 3 十 (R2 十 Ra 十 R5) R5D 一 瑟 2 
民 4 刀 R5sP 二 (R4 二 Rs 十 Rb)n =0. 


Use Program 3.3 to Solve for the current 71, 72, and 73 证 
(3a) 尺 1 一 1 Ra 一 1,R3 一 2, 一 1 尺 5 一 2,R5 一 4,and 五 1 一 23, 五 2 一 29 
(b) 尺 ; = 1 R2 一 0.7$, 有 3 三 1,R4 = 2, 8R5 一 1, 86 一 4,and 五 1 一 12， 
羽 一 21.5 
(Cj) 尺 I=1,R2 三 2,R3 一 4,R4 三 3,RR5 三 1R6 三 Sand 匹 1 一 41 瑟 2 王 38 
S. In calculus the following integral would be found by the technique of partial fractions: 


1/ X2 十 X 十 ] 1 
TO CR 302 二 人 


This would require finding the coeficients 4i, fori 一 1, 2, ...,6, in the expression 


X2 十 xx 十 1 
人 DO 2 3)20x2 十 1 
4 42 43 44 ASsx 十 46 
一 人 人 人 


Use Program 3.3 to find the partial fraction coefficients. 


6. Use Program 3.3 to sojlve the linear system 4 大 = 妃 , where 4 is generated us- 
ing the MAILAB command A=rand(10,10) andB=[Lt 2 3 ... 10]，. Remem- 
ber to verify that 4 is nonsingular (det (A) 天 0) before using Program 3.3，Check 
the accuracy of your answer by forming the matrix difference 4 一 怠 and ex- 
amining how close the elements are to zero (an accurate answer would produce 
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4 和 卫 三 0， Repeat this process using a coefcient matrix 4 generated by the 
command A=Tand(20,20) and B=[1 2 3 ... 20]:. Explain any apparent di 
ferences in the accuracy of Program 3.3 on these two Systems. 


。 In (8) of Section 3.1 we defined the concept of linear combination in NW-dimensional 


Space， For exampie, the vector (4， 3), which is equivalent to the matrix [4 。” 3] 
could be written as alinear combinationof [1 0] and[f0 ]: 


| 引 -*j*ca 国 


Use Program 3.3 to show that the matrix [1 3 5 7 9] canbe written as alinear 
combination of 


and 


一 WUDiD 睛 情 
人 上 呈 品 书 
一 (hn 尼 和 
局 局 了 了 tn 
尼 ~i 忆 上 一 


Explain whby any matrix [2 X2 2X3 X4 x5] can be written as a linear combina- 
tion of these matrices. 


Iterative Methods for Linear Systems 


The goal of this chapter is to extend some of the iterative methods introduced in Chap- 
ter 2 to higher dimensions，We consider an extension of fxed-point iteration that ap- 
plies to systems of linear equations. 


Jacobi Iteration 


Example 3.26， Consider the system of equations 


(D) 


4x 7 十 Z= 7 
4x 8y+ z= 21 
2x 十 7 十 $Sz = 15. 


These equations can be written in the form 


(2) 


7 十 ? 和 
4 
21 十 4x 十 z 
”一 
_13+2x 》 


5 


AM 


上 
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Table 3.2 ”Convergent Jacobi Iteration for the Linear 























System (]) 

开 

0 1.0 2.0 2.0 - 

1 1.75 3.375 3.0 

2 1.84375 3.875 3.025 

3 1.9625 3.925 2.9625 

4 1.99062500 3.97656250 3.00000000 

5 1.99414063 3.99531250 3.00093750 
1.99999993 3.99999985 2.99999993 


2.00000000 4.00000000 3.00000000 


This suggests the following Jacobi iterative process: 


加 由 7 十 次 下 
kt 一 一 4 人 
21 十 4xx 十 Z 
G) HI 一 一 人 
1 十 2xXK 凑 
ZK 二 1 一 5 


Let us show that 证 we start with Po 一 (xo, y0, z0) 一 (1,2, 2), then the iteration in (3) 
appears to converge to the Solution (2, 4, 3). 

Substitute xo 一 1, yo = 2, and zo = 2 into the right-hand side of each equation in (3) 
to obtain the new values 


7+2 2 
X1 一 四 一 1.743 
4+2 
2)1 = 一 全 二 < -3.375 
15+2 2 
2 了 +2 二 二 3.00. 


The new point P1 = (1.73, 3.37$, 3.00) is closer to (2,4, 3) then 己 o，、Iteration us- 
ing (3) generates a Sequence of points { 有 that converges to the solution (2, 4, 3) (see 
Table 3.2). 恒 


This process is called Jacobi zteration and can be used to solve certain types of 
linear systems，After 19 steps, the iteration has converged to the nine-digit machine 
approximation (2.00000000, 4.00000000, 3.00000000). 
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Linear Systems with as many as 100,000 variables often arfise in the solution of 
partial differential equations，The coeffhcient matrices for these Systems are Sparse; 
that js,，a large percentage of the entries of the _ coefficient matrix are zero、If there 
is a pattern to the nonzero entries (1.e., tridiagonal Systems), then an iterative process 
provides an efficient method for solving these large Systems， 

Sometimes the Jacobi method does not work，Let us experiment and see that a 
rearrangement of the original linear system can result in a system of iteration equations 
that will produce a divergent sequence of points. 


了 Example 3.27。 Let the linear system (1) be rearranged as follows: 


2 十 》 十 $z 一 1 
(4) 4fr 8y+ z= 21 
4X yy 十 z 一 7. 


These equations can be written in the form， 


_ 15 二 yy+5z 
本 3 
(5) 21 十 4r 十 2 
7 = 一 一 一 
8 
Z 一 7 4xr 十 y. 


This suggests the foliowing Jacopbi iterative process: 


1 十 次 十 Szk 

Xk+1 二 人 
(6) 21 十 4xk 十 ZK 
JI+1 一 gg 


Zkt+1 一 7 4xk 十 了 其， 


See that 这 we start with Po 王 (Co, y0, z0) = (1 2,2) then the iteration using (6) will 
diverge away from the solution (2, 4, 3). 

Substitute xzo = 1, X = 2, and z0 = 2 into the fight-hand side of each equation in (O) 
to obtain the new values xl, y1，and zl: 


15+2+10 

= = 
21 十 4 十 2 

?1 = 一 一 -3.375 


z1=7 4+2=53.00. 


1.3 


Thenew point 己 ; = ( 1.5$, 3.37S, 5.00) is farther away fromthe solution (2, 4, 3) than P0. 
Iteratior using the equations in (6) produces a divergent Sequence (See Table 3.3)， 国 
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Table 3.3 ”Divergent Jacobi Iteration for the Linear 
System (4) 



















大 

0 

1 

2 

3 。 

4 46.617188 17.8125 123.73438 
5 307.929688 36.150391 211.28125 
6 124.929688 


502.62793 1202.56836 


Gauss-Seidel Iteration 


Sometimes the convergence can be Speeded up. Observe that the Jacobi iterative pro- 
cess (3) yields three Sequences {ztj, {ykj, and {zxj that converge to 2, 4, and 3, respec- 
tively (see Table 3.2). It seems reasonable that x+1 could be used in place of xx ip 
the computation of 次 +1. Similarly,， xxk+l and 灵 +1 might be used in the computation 
of zxk+1， The next example shows what happens when this is applied to the equations 
in Example 3.20. 


了 Example 3.28， Consider the system of equations given in (1) and the Gauss-Seidel itera- 
tive process Suggested by (2): 


7 十 次 下 
4Xk+1l 一 一 4 
21 十 4xk+1 十 直 
(7) Jrl 三 一 一 一 
13 十 2xk+HI 其 +1 
ZK 二 1 一 站 


See thatif we start with Po 三 (zx0, y0, z0) = (1 2, 2), then iteration using (7) will converge 
to the solution (2, 4, 3). 
Substitute yo 一 2 andzo = 2 into the first equation of (7) and obtain 


7+2 2 
站 = 一 人 175 


Then substitute xl 三 1.75 and z0 = 2 into the second equation and get 


21 十 4(1.7S) 十 2 
1= 一 荆 -2 二 本 ) 十 一 3.74. 


Finally, substitute xl = 1.75 and y! = 3.7S into the third equation to get 


。 1$ 十 2(1.73) 3,.75 
1 一 一 人 人 人 人 人 Cr 


一 2.9S. 
5 
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Table 3.4 Convergent Gauss-Seidel Iteration for the 

















System (]) 
大 
0 1.0 2.0 2.0 
1 1.75 3.75 2.95 
2 1.95 3.96875 2.98625S 
3 1.993625 3.99609375 2.99903125 
8 1.99999983 3.99999988 2.99999996 
9 1.99999998 3.99999999 3.00000000 








2.00000000 4.00000000 


The new point P1 = (1.7$, 3.7$, 2.9S) is closer to (2, 4, 3) than 已 o and is better than the 
value given in Example 3.26. Feration using (7) generates a Sequence { Pt that converges 
to (2,4,3) (See Table 3.4). [| 


In view of Examples 3.26 and 3.27, it is necessary to have Some criterion to de- 
termine whether the Jacobi iteration w 记 converge，Hence we make the following 
definition. 


Definition 3.6. A matrix 4 of dimension N x Nis said to be strictpy diagora 有 7 
domaizaazat provided that 


从 

(3) lettl > > ab for 一 1 2, ..，N. 和 
7=1 
7 


This means that in each row of the matrix the magnitude of the element on the 
main diagonal must exceed the sum of the magnitudes of all other elements in the row'. 
The coefficient matrix of the linear system (1) in Example 3.26 is strictly diagonally 
dominant because 


Imnrowl: > 1U+IH 
In row 2: | 8l> fl 十 叶 
In row 3: | 和 > 1 2 十 | 


All the Tows Satisfy relation (8) in Definition 3.6, therefore, the coefficient matrix 4 
for the linear System (1) is strictly diagonally dominant. 
The coefhicient matrix 4 of the linear system (4) in Example 3.27 is not strictly 
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diagonally dominant because 


In row 1: | 2|<|H+I| 
In row 2: | 8 >|I4I 十 HH 
In row 3: 11 < II4 十 | 了 井 ， 


Rows 1 and 3 do not satisfy relation (8) in Definition 3.6; therefore, the_ coefficient 
matrix 4 for the linear System (4) is not stricdy diagonally dominant. 

We now generalize the Jacobi and Gauss-Seidel iteration processes. Suppose that 
the given linear System is 


Q11X1 十 012X2 十 :十 Cj11) 十 十 QINXN 一 及 
C21X1 十 42272 十 …… 十 02j1X1 十 :… 十 G2NXN 一 六 2 


(9) 


0jIXI 十 QGj12X2 十 十 Q1j101 十 十 GjiNXN 一 六 ) 


CNIXI 十 GN2X2 十 …' 十 QNiX1) 十 … 十 GNNXN 一 DDN， 


Let the Kth point be 5 一 (cx 的， 。、 X)， 。。 人 )， then the next point is 


XN 
尼 上 +1 一 (Ce 人 +， 2 ssX)， .CD)， The Superscript (K) on the coor- 


dinates of Pr enables us to identify the coordinates that belong to this point，The 


9 


iteration formulas use row 六 of (9) to solve for x+D in terms of a linear combination 
of the previous values xf，x49， 0 0 
Jacopi ieration: 
ax 多 人 人 
4 户 


for ) = 1 2, ...，N. 
Jacobi iteration uses all old coordinates to generate all new coordinates, whereas 
Gauss-Seidel iteration uses the new coordinates as they become available: 


GaLHSS-Seidey 1terarion: 


， (KR 十 ]) (十 1]) 本 ( 昌 本 
(1D x+D 一 DGj1X1 1 oj NEN 
C 记 


for / = 1 2,...，N. 
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The following theorem gives a sufficient condition for Jacobi iteration to converge. 


Theorem 3.1S (Jacobi Iteration)， Suppose that 4 is a strictly diagonally dominant 
matrix， Then 4 天 一 玉 has a unique solution 蕊 一 尼 ， iteration using formula (10) 
will produce a sequence of vectors { 忆 5] that will converge to 书 for any choice of the 
starting Vector 忆 0. 


Prooj The proof can be found in advanced texts on numerical analysis. @ 


It can be proved that the Gauss-Seidel method will also converge when the ma- 
trix 4 is strictly diagonally dominant，In many cases the Gauss-Seidel method will 
converge faster than the Jacobi method; hence it is usually preferred (compare Exam- 
ples 3.26 and 3.28)、It is important to understand the slight modification of formula 
(10) that has been made to obtain formula (11). In some cases the Jacobi method will 
ConveIge even though the Gauss-Seidel method will not. 


Convergence 


A imeasure of the closeness between vectors is needed so that we can determjne 下 
{Pkj is converging to 尼 ，The Euclidean distance (See Section 3.1) between 玉 一 


GD 7XN) and 晕 (1 2 ，yN) is 
和 1/2 
(12) IP 纪 = (2 呆 】 . 
j=1 


Its disadvantage is that it requires considerable computing effort. Hence we introduce 
a different normy, || 瑟 l1: 


人 
(13) | 有 = >》 lz 让 
/一 1 


The following result ensures that || 忆 上 has the mathetmatical structure of a metric 
and hence is suitable to use as a generalized“distance formula ”From the study of 
linear algebra we know that on a finite-dimensional vector space all norms are equiv- 
alent; that is, 这 two vectors are close in the ||*lll norm, then they are also close in the 
Euclidean noroma ||*||. 


Theorem 3.16， Let 和 and 了 be NW-dimensional vectors and c be a scalar Then the 
function || 瑟 ‖ has the following properties: 


414) | 人 兰 0， 
(15) Il=0O0 itandonlyi 瑟 =0， 
(10) |c 过 由 = lc 全， 


(17) | 上 过 十字 < Tb 十 上 
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Prooj We prove (17) and leave the others as exercises， For each j ,the triangle 


inequajity for real numhbers states that jz 十 y 首 < |x 咱 十 jy 中 Summing these yields 
inequality (17): 


和 人 六 
| 瑟 + 了 = 2 pr+I<》 pl Di= IE +IZD， 
7 一 1 J 一 1 Jj=1 
The norm given by (13) can be used to define the distance between points. @ 


Definition 3.7. Suppose that 在 and 了 are two points in N-dimensional space. We 
define the distance between 下 and 了 in the ||* 人 norm as 


RN 
II 7 => py yi 和 
j=1 


Example 3.29. Determine the Euclidean distance and |*l distance between the points 
忆 = (2,4,3) and CQ = (1.75, 3.7$, 2.95). 
The Euclidean distance is 


IP Q@I=(2 173)+(4 3.73)2 十 (3 2.95)2)172 = 0.3570， 


The ||*|l distance is 
IlP ON=l2 1.75I+I4 3.75|+13 2.95| = 0.55. 


The |*l is easier to compute and use for determining convergence in N-dimensional 
Space， 国 


The MAILAB command A(j,L1:j-l,jtl:N]) is used in Program 3.4，This 
effectively selects all elements in the jh row of 4， except the element in the jth 
column (ie., A(j ,j)) Thbis notation is used to simplify the Jacobi iteration (10) step 
in Program 3.4. 

In both Programs 3.4 and 3.5 we have used the MATLAB command norm, which 
is the Euclidean norm，The ||*lli can also be used and the reader is encouraged to 
check the Help menu in MATLAB or one of the reference works for information on 
the norm command. 








RProgram 3.4 (Jacobi Iteratiom)，To solve the linear system 4 天 一 肪 by starting 
with an initial guess 于 一 Po and generating a sequence { 书 f] that converges to the 
solution. A sufficient condition for the method to be applicable is that 4 is strictly 
diagonaly dominant. 







function X=jacobi(A,B,P,qelta，max1t) 


% Input ~ Ais anNXxNnonsingular matTrixX 
区 -Bis anNX1T1 matrix 
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久 -Pis anN XI matrix; the initial guess 
儿 - delta is the tolerance for P 
% - max1l is the maximum numnber of iterations 


% output -Xis an JJ xXx1T matrix: the jacobi approximation to 
% the Solution of AX = B 
N = length(B) ; 
Eor K=1 :maxt 
for j=1:N 
X(j)=(B(j)-A(j, [1:j-1,j+l:N)*P([t:j-1,j+l:N]))VACG Di; 
end 
erT=abs (norm(X):-P)); 
TelLerTr=err/ (norm(X)+eps) ; 
P=X) ; 
if(err<delta) | (relerr<delta) 
-breakx 
end 


Program 3.S (Gauss-Seidel Iteration). To solve the linear system 4 天 一 
by starting with the initial guess 在 一 Po and generating a Sequence { 忆 5} that 


Converges to the solution. A suffcient condition for the method to be applicable is 
that 4 is strictly diagonally dominant. 





function X=gseid(A,B,P,delta，max1) 


到 


办 Input - A is an NXxNnonsingular matTrjix 


久 -BisanNX1 matrix 
7 -Pis anNX1tmatrixi the initial guess 
六 - delta is the tolerance for P 
% - maxl is the maximum Dunber of iterations 
% Output - X is an N Xx1matrix: the gauss-seidel 
X appProximation to the solution of AX = B 
N = Length(B) ; 
Tor X=1:max1 
for j=1:N 
if j==1 
X(1)=(B(1)-A(1,2:N)*P(2:N))VA(C1,1) ; 
elseif j== 
XCN)=(B(CN)-ACN 1:N-1)*(XCL:N-1)) 7)VACNN) ; 
elSse 


人 X contajins the kth approximations and P the (k-1)st 
X(j)=(B(G)-A(j ,1:j-1D)*X(C1:J-1) 
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-A(j,j+t1:N)*P(j+l:N))VAC，jD) 1; 
end 
endQ 
erT=abs (norm(X:-P) ) ; 
TelLerr=~err/ (norm(X)+ePps) ; 


P=X7 ; 
if(err<delta) | (Yelerr<delta) 
bTreakr 
end 
end . 
X=X) ; 


了 Exercises for Iterative Methodqs for Linear Systems 





In Exercises !1 through 8: 

(a) Start with Po = 0 and use Jacobi iteration to find PP forK = 1 2, 3. Will Jacobi 
iteration converge to the solution? 

(b) Start with Po = 0 and use Gauss-Seidel iteration to fnd Pi for 大 = 1 2, 3. Wi 
Gauss-Seidel iteration converge to the solution? 


1 4x yy= 15 2， 8x 3y= 10 
XZ 十 957 一 9 X 十 47 一 6 

3. X 十 3y 一 1 4 2x 二 37 一 1 
6x 27 一 2 7xX 2y= 

sS.、 Sr  y 二 zz= 10 6. 2x7 十 8y  Zz 一 外 
2x 十 8y 7z= 1 Sr  y+z= 10 
X 十 十 4z 一 3 X 十 yy 十 4z= 3 

7. ZX 39y 7z= 8 8. 4x 二 yy 2z=13 
4x 十 》 7Zz= 13 X SS 7Zz= 8 
2x yy》 6z= 2 2x yy 6z= 2 


9.Let 下 = (1 22, ..,XN). Prove that the ||*|| norm 


六 


上 = 》 xl 


业 1 


Satisfies the three properties (14)--(16). 
10. Let 天 一 (xl1, 2 .,XN). Prove that the Euclidean norm 


入 17/2 
| 民 | 一 (2 


大 一 1 
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Satisfies the four properties given in (14)--(17). 


11. Let = (xl,x2，...,XN). Prove that the ||*llw norm 
一 In3aX 
Illoo 一 ,max lz 


satisfies the four properties given in (14)--(17). 


Algorithms and Programs 
ee | 


1.、Use both Programs 3.4 and 3.5 to solve the linear systems in 已 xercises 1 through 8. 
Use the format long command and delta 一 10 9. 


2. In Theorem 3.14the conditionthat 4 be strictly diagonally dominantis a suffticient but 
not necessary condition， Use both Programs 3.4 and 3.$ and several different initial 
guesses for Po on the following linear System. Note. The Jacobi iteration appears to 
converge, while the Gauss-Seidel iteration diverges. 


邯 十 Z 一 2 
X 十 y = 一 0 
x+ 二 2y 3z=0 


3.，Consider the following tridiagonal linear system, and assume that the coefficient ma- 
trix is Strictly diagonally dominant. 


dIxl 十 Cl12X2 一 及 
QIX1 十 C2x2 十 c2X3 一 02 
C2X2 十 d3X3 十 C324 一 203 


CN 2XN 2 十 GdN 1XN 1 十 CN LN 一 pbN 1 
aN 12N 1 十 GvxN 一 N. 


是 Write an iterative algorithm, following (9)-(11), that will solve this System.， YOUT 
algorithm should ef 从 ciently use the “sparseness” of the coefficient matrix.， 

(i Constructa MAILAB programbased on youralgorithm in and solve the following 
tridiagonal systems， 
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(3) 411 十 12 一 3 (pb) 41l 十 12 一 | 
1tl 十 4 十 113 一 3 1i1 十 412 十 13 一 2 

112 十 413 十 4 一 3 112 十 4113 十 14 一 工 

113 十 414 十 1 一 3 113 十 414 十 5 三 2 

殉 48 十 41149 十 1050 一 3 1148 十 41449 十 750 三 | 

1149 十 417150 一 3 1a49 十 41350 一 2 


4、Use Gauss-Seidel iteration to solve the following band system. 


12x1 2xX2 十 X3 一 
2X1 十 12x2 2X3 十 区 一 $ 
X1 2x2? 十 12X3 2x4 十 Xx 一 $ 


2 2X3 十 12X4 2X5 十 3%6 三 9 


X46 2x47 十 12x48 2x49 十 X50 王 5 
2X47 2X48 十 12x49 2x50 一 
X48 2x49 十 12x50 一 


S. In Programs 3.4 and 3.3 the relative error between consecutive iterates is Used as a 
stopping criterion. The problems with using this criterion exclusively were discussed 
in Section 2.3. The linear System 4 下 = 且 can be rewritten as 4 有 及 一 0. 开 下 
is the Kth iterate from a Jacobi or Gauss-Seidel iteration procedure, then the norm of 
the residual 4XKE 五 js, in general,a more appropriate stopping criterion. 
Modify Programs 3.4 and 3.5 to use the residual as a stopping criterion，Use the 
mod 褒 ed programs to solve the band system in Problem 4. 


Iteration for Nonlinear Systems: 
Seidel and Newton's Methods (Opbtional) 


Iterative techniques will now be discussed that extend the methods of Chapter 2 and 
Section 3.6 to the case of Systems of nonlinear functions. Consider the functions 


@ hi, 太 = 妇 2r yy+0.5 
户 (人 尹 二 好 十 4 人 2 4. 

We seek a method of solution for the System of nonlinear equations 

(2) Ji 六)=0 and xy)=0. 


The equations 广 (x,y) = 三 0and Pa 良 =0implicitly dehne curves in the xy- 
Plane, Hence a Solution of the System (2) is a point (P, 9) Where the two cuUrves cross 
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》 y= 刀 一 2x+0.5 





Figure 3.6 ”Graphs forthe nonlinear system y 一 x*2 2x 十 0.5 
and xz 十 472 = 4. 


(ie., both 万 (p,a) = 0and P(p,9) = 0). The curves for the system in (1) are well 
known: 


xz 2x+0.5=0 isthe graph of aparbola， 


G) 2 2 . . 
X 十 4》” 4=0 isthegraphofanellipse. 


The graphs in Figure 3.6 show that there are two solution points and that they are in 
the vicinity of ( 0.2, 1.0) and (1.9, 0.3). 

The first technique is fixed-point iteration. A method must be devised for generat- 
ing a sequence {(Pk, gk)} that converges to the solution (P, g), The first equation in (3) 
can be used to solve directly for zx. However a multiple of y can be added to each side 
of the second equation to get x2 十 4y2 8y 4 一 8y.Thechoice of adding 8y is 
crucial and will be explained later, We now have an equivalent system of equations: 


2 
罗 7 十 0.3 
(人 “ 
xz 472 十 8y 十 4 
7 一 


These two equations are used to write the Tecursive formulas. Start with an initial point 
(po, 9qo), and then compnute the sequence {(Pk+l dk+UDj using 


有。 和 十 0.5 
PK+l = 81CDk, 9k) 一 一 
G) 2 2 
Pr 44 十 89k 十 4 


dk+1 三 82(Pk,， 9k) 一 8 
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Table 3.5 ”Fixed-Point Iteration Using the Formulas in (9) 








Case (ij: Start with (0, 1) Case (ii): Start with (2,0) 
































大 PK 

0 0.00 

1 0.25 

2 0.21875 

3 0.2221680 0.9939880 0.6085510 
4 0.2223147 0.9938121 2.4820360 
5 0.2221941 0.9938029 15.891091 
6 0.2222163 0.9938095S 392.60426 

7 0.2222147 0.9938083 205,477.82 

8 0.2222145 0.9938084 This sequence is diverging. 

9 0.2222146 0.9938084 


Case ( 动 开 we use the starting value (po, 90) = (0, 1), then 


0? 1 十 0.5 0 4(D2+8D 十 4 
站 一 二 十 >- 0.25 and 1 = 40 +8D+4_ 
2 8 
Iteration will generate the sequence in case (i) of Table 3.5. In this case the sequence 
converges to the solution that lies near the starting value (0, 1). 
Case ( 蔓 : 玉 we use the starting value (po, 9g0) 王 (2, 0),then 


1.0. 


2 2 2 

站 一 2” 0 十 0.5 -225 and 9- 2 4(0) 十 8(0) 十 4 _ 
2 8 

Iteration will generate the sequence in case (i of Table 3.$. In this case the sequence 

diverges away from the solution, 

Iteration using formulas (3$) cannot be used to find the second solution (1.900677， 
0.3112186). To find this point, a different pair of iteration formulas are needed. Start 
with equation (3) and add 2x to the first equation and 117y to the second equation 
and get 


0.0. 


六 4x y+05= 2x and 刀 +472 1 4= 11y. 


These equations can then be used to obtain the iteration formulas 


2 十 4 十 9 0.$ 
ZKk+1l 一 81(CPDk， GK) 一 人 
(0) 2 2 
Pf 49r 十 119 十 4 
11 


Table 3.6 shows how to use (6) to find the second solution. 


dk+1 一 82(Pk，GK) 一 
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Table 3.6 ”Fixed-point Iteration Using the 
Formulas in (6) 












大 

0 

1 

2 

3 0.1776676 

4 1.808345 0.2504410 

8 1.903595 0.3160782 
12 1.900924 0.3112267 
16 0.3111994 
20 0.3112196 
24 


0.3112186 


Theory 


We want to determine why equations (6) were Suitable for finding the solution near 
(1.9, 0.3) and equations ($) were not， In Section 2.1 the size of the derivative at the 
fxed point was the necesSsary idea， When functions of Several variables are used, the 
partial derivatives must be used，The generalization of “the derivative”for systems 
of functions of several variables is the Jacobian matrix， We wi 刘 consider only a few 
introductory ideas regarding this topic. More details can be found in any textbook on 
advanced calculus. 


Definition 3.8 (Jacobian Matrix),， Assume that 证 (xz, y) and 户 (x, y) are functions 
of the independent variables x and y; then their Jacobian matrix (xz, yis 


纺 也 
gO) 0x 87 
护 纺 
0x 89y 


Similarly 计 亡 (x, yz) 户 (x, yz and 户 (k, yz) are functions of the independent 
variables x, y, and z, then their 3 x 3 Jacobian matrix (xz, y, z) is defined as follows: 


纺 3 也 
0x 9y 0z 
8 0 8 
沪 沪 用 
0x 0y 8z 
0ox 0y 0z 
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Example 3.30. Find the Jacobian matrix jxz,y,z)oforder3x3atthe point (1,3,2) 
for the three fanctions 


户 G oO 一 三 疙 + 寺 十 
JP yz) 一 ZX7 十 yZ 十 XZ 


》 
有 户 (x yz) = 一， 
XZ 


The Jacobian matrix is 


太 纺 
ax 07 8z 3x2 27 十 1 4z3 十 2z 
| 及 8 |y+z x+z ?十 X 
JGC yz) 一 3 ay 3z 一 了》 工 >》 
所 护 3 广 xz 2 
ar 397 az- 


Thus the Jacobian evaluated at the point (1, 3, 2) is the 3 x 3 matriX 
国 


For a function of several variables, the differential is used to show how changes of the 
independent variables affect the change in the dependent variables. Suppose that we 
have 


rasa| 


tlw Cn 
MI 一 人 Cn 
了 Pi 人 00 


Generajlized Differential 


(9) & 一 万 yz)， 1 = 有 户 (yz)， and 凯 二 户 (x， yz). 


Suppose that the values of the functions in (9) are known at the point (xo, yo, z0) 
and we wish to predict their vajlue at a nearby point (x, y, z)，Let du, du, and dm 
denote differential changes in the dependent variables and dx, dy, and dz denote dif- 
ferential changes in the independent variables. These changes obey the relationships 


0 0 0 
du = am， y0, z0) Gx 十 oro， y0, z0) dy 十 on， yo, z0) dz， 
Dx 0y 0z 
0 记 0 户 8 
(10) du 一 2 y0, z0) dx 十 光 ou， yo, z0) dy 十 oo， 》y0, z0)] dz， 
ax 9y 0z 


3 户 3 有 户 8 有 亡 
du = -一 (xzo, yo0,z0) dx 十 -一 (xo, yz0)dy 十 5 (xzo, y0, z0) dz. 
0zx 0y 8z 
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玉 vector notation is used，(10) can be compactly written by using the Jacobian 
Imatrix. The function changes are dF and the changes in the variables are denoted d 下 . 


CU CX 
(11) d 天 =|du|=JGo,yozo)ildy | = Co yo,z0) dd 于. 
dt dz 


Exarmple 3.31， Use the Jacobian matrix to find the differential changes (da du Gd 芭 ) 
when the independent variables change from (1, 3, 2) to (1.02, 2.97, 2.01) for the System 
of functions 


一 万 人 一 妇 闪 才 十 2 


1 一 户 (yz) 一 zy 十 yZ 十 XZ 
凯 = 户 (x, yz) 三 二 . 
芳 民 


Use equation (11) with (1,3,2) of Example 3.30 and the differential changes 
(dx,dy,dz) = (0.02， 0.03, 0.01) to obtain 


du 3 28] [0.02 0.07 
d 恕 |=| 5 4|| 0.03 | = 0.05 | . 
du 闻 二 引 | 0.01 0.0525 


Notice that the function values at (1.02, 2.97, 2.01) are close to the linear approxima- 
tions obtained by adding the differentials dx = ”0.07, du = 0.05, and duw 一 ”0.0525S to 
the corresponding function values 万 (1,3,2) 一 17, 户 ( 3,2) = 一 1l and 方 (1,3,2) = 
1.S; that is， 


(一 wo An 


用 (1.02, 2.97,2.01) = 17.072 交 17.01= 万 (3,2)+du 
万 (1.02, 2.97,2.01) = 11.0493 久 11.05 = 户 (1,3,2) 十 dv 
. 户 (1.02, 2.97,2.01) = 1.44864 汪 1.4475 = 户 (1, 3, 2) 十 duw. 


Convergence Near Fixed Points 

The extensions of the definitions and theorems in Section 2.1 to the case of two and 
three dimensions are now given，The notation for N-dimensional functions has not 
been used， The reader can easily find these extensions in many books on numerical 
analySis， 

Definition 3.9， Aixed poinl forthe system of two equations 

(12) Z=8SI 7) and 》 了 =82(0,y) 


is a point (Z, 9) such that 疡 三 8IP,9) anddg = 8(pP,9). Similarly in three dimen- 
Sions a fxed point for the system 


(13) X=8lC yzZ)， yy=820y 2) and Z“=830, yz) 
is apoint (P, 9g,r) such that 忆 一 81(p,qg,r,9g 一 82(pD,q,r)andr 一 83(PD，9，r 让 和 
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Definition 3.10. Forthe functions (12)，jixed-poipt iterazhom is 


(14) Phk+l 王 8ICDk ai and Gdk+l 王 820Dk, gb 


for 有 = 0, 1 .... Similarly, for the functions (13),， jixed-poizt iterafior is 


Ph+1 = 一 81(PDk, qh rt) 
(15) GK+1 三 82(Pk, 9gK 太 ) 
FL 三 83(PK， 9 天) 


for 有 = 0, 1 .... 全 


Theorem 3.17 (Fixed-Point Iteration). Assume that the functions in (12) and (13) 
and their frst partial derivatives are continuous on a region that contains the fixed point 
(P,9) or (P,9g,r), respectively. 于 the starting point is chosen sufficiently close to the 
fxed point, thea one of the following cases applies. 

Case (让 To Ginensio1y. 开 (po, go) is sufficiently close to (p,g) and 让 





3 
如 .9 十 要 e.g < 1， 
》 


(10) ag 3g 
2 2 
要 (P， 9 十 要 9 < 1 
? 
then the iteration in (14) converges to the fxed point (P, 9). 
Case ( 刘 Three dintertsions，I (po,go,ro) is suffciently closeto (p,9g,r) and 证 




















3g1 081 

下 d,7)| 十 + 型 (P,9,r) +| 弄 we， 方 | < |， 

(7) pg, 上 +| 王 (peertprnl<1l 
907y 02 
083 083 

区 (P,9q,r)| 十 罕 (P, gr +| 百 (PP,9,r)| < | 











then the iteration in (1S) converges to the fixed point (P,g,7). 


开 conditions (16) or (17) are not met the iteration might diverge. This will usually 
be the case 过 the sum of the magnitudes of the partial derivatives is much larger than 1. 
Theorem 3.17 can be used to show why the iteration (S) converged to the fixed point 
near ( 0.2, 1.0). The partial derivatives are 


0 0 1 
了 玉 9 力 二 交 5SC 7) 一 7， 


2 pt,= 工人)= yy+1 
了 2 也 一 4 3782 区 ，》 一 了 “ 
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Indeed, for all (x, y) satisfying 0.3 < < 0.$and0.3 < y< 1.S, the Partial 
derivatives Satisfy 





0 0 
一 8I(, yy)| 十 | 一 8 y)| 三 zl 十 | 0.3| < |， 
0x 0y 


= 一 过 + 7 十 1 < 0.625 < 1. 
Therefore, the partial derivative conditions in (16) are met and Theorem 3.17 implies 
that fxed-point iteration will converge to (P,d) 羡 ( 0.2222146, 0.9938084). Notice 
that near the other fxed point (1.90068, 0.31122) the partial derivatives do not meet 
the conditions in (16); hence convergence is not guaranteed. That is， 








0 0 
站 + 一 82(0x， y) 
Dx ay 


十 


二 81(1.90068， 0.31122) = 2.40068 > |， 
大 











0 
贡 81(120068， 0.31122) 
了 





8 0 
二 ed.90068 031122 十 1 计 szGoo06s， 031122 = 1.16395 > 1. 
蕊 


Seidel Iteration 


An improvement, analogous to the Gauss-Seidel method for linear Systems, of fxed- 
point iteration can be made，、Suppose that PKk+l NS used in the calculation of Gk+1 
(in three dimensions both Pr+l and Gk+l are used to compute +1)，When these 
modifications are incorporated in formulas (14) and (1$), the method is called Seiael 
zeratiom: 


(13) Pk+1 王 8Sl(Dk, qt and 9k+l 一 82(Dk+1 96， 
and 
PK+L 一 8I(Pk di 站 ) 


(19) GK+1 一 82(0PDK+D Qi 太 ) 
+1 一 83(CPKE+1,， GKHL， 1) 


Program 3.6 w 鹿 Implement Seidel iteration for nonlinear systems. Implementa- 
tion of fxed-point iteration ls left for the reader, 


Newton's Method for Nonlinear Systems 


We now outline the derivation of Newton's method in two dimensions.Newton's 
method can easily be extended to higher dimensions. 
Consider the system 


(20) 2& 一 万 (xz,y) 
4 三 户 (x, y)， 
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which can be considered a transformation from the xy-pPlane to the UV-plane. We are 
interested in the bebavior of this transformation near the point (x0o, y0) whose image 
is the point (zxo, v0). If the two functions have continuous partial derivatives, then the 
differential can be used to write a system of linear approximations that is valid nearthe 
point (xz0，y0): 


8 0 
U 1M0= 一 万 (xo, yo)(C xz0) 十 一 万 (xzo, yo)(y7  y0)， 
0x Dy 
(21) 3 3 
= 一 户 (xo, yo xzo) 十 一 户 (xzo, yo0)(7 yo0)， 
DOX 0y 
The system (21) is a local linear transformation that relates Smal changes in the 


independent variables to Small changes in the dependent variable. When tbe Jacobian 
matrix (xzo, yo) is used, this relationship is easier to visualize: 


0 0 
到 态 (xzo, 7y0) 太刀 (xzo, y0) 
并 -| 习 
了 0 


8 8 
一 户 (x0, 7y0) 一 户 (xzo, 加) 
0x 0y 
I the system in (20) is written as a vector function Y = 下 ()，the Jacobian 
J(c,y) is the two-dimensional analog of the derivative, because (22) can be written as 
(23) A 下 之 71(xo, y0) A 天 . 


We now use (23) to derive Newton's method in two qimensions， 
Consider the system (20) with wk and u set equal to zero: 


0 = 万 (x， 7) 
24 
(0 0 = 户 (xc 
Suppose that (P,q)isasolution of (24); that is， 

0= 万 (p,9) 
(25) 

0= 户 (p,9). 


To develop Newton's method for solving (24), we need to consider small changes 
in the fnctions near the point (po, 9g0): 


Ar 一 ， Ap 一 。 
o6) & 一 2 0 忆 = po 
Au = Do0， Ad=》 940. 


Set (xy) = (P,9)ina(20) anduse (2S)to See that (4 V) = (0, 0). Hence the changes 
in the dependent variables are 
UL zt = 及 (p,4) 万 (po,q0)=0 (po,90) 


27 
7) 1 = 上 户 (p,9) 有 户 (po,4qo0)=0 户 (po,90). 
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Use the result of (27) in (22) to get the linear transformation 


0 


DX 


0 
户 (po,40) 矶 7 1(p0, g0) 
028) ? | 


名 | 轴 区 (Po， 中 | 


3 3 Ad 户 (po, 40) 
一 上 户 (po,9q0) 一 万 (p0, 40) 
ax 0》 


Ifthe Jacobian J(po, go) in (28)is nonsingular wecan solvefor AP = [Ap Ada] = 
[p 9g] [mo do] as follows: 


(29) As J(po,4o) ，F(po,q0)， 
Then the next approximation 书 1 to the solution 忆 is 
(30) P1= Po 二 AP= Po J(po,qo) :FF(po, 40). 


Notice that (30) is the generalization of Newton's method for the one-variable case; 
that is, pl = Po (Po)/ 广 (po)， 


Outiine of Newton's Method 


Suppose that 忆 f has been obtained. 
Step 7、Evaluate the function 


| 六 Cdqb) 
一 [人 29 ， 


Step 2，Evaluate the Jacobian 


0 


0 
了 PCpi gt) 一 户 (Pk,ghb) 
大 9y 


J(CPb 一 3 
区 万 (Pb 9 到 PPe 96) 
Step 3，Solve the linear system 
J(Pk)AP = PFCPk) for AP. 
Step 4， Compute the next point: 
忆 +1 一 5 十 人 也. 


Now, repeat the Process. 
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Exampjle 3.32， Consider the nonlinear systermn 


0=xz 2r y+0.5 
0= 症 477 4. 


Use Newton's method with the starting value (po, 40) = (2.00, 0.25) and compute (P1, 91)， 


(P2, g2), and (p3, 93). 
The function vector and Jacobian matrix afe 


X2 2x 十 0.5 2x 2 1 
Fe .=| 4 4 | Je.5=| 2 8y ， 


Atthe point (2.00, 0.2S) they take on the values 


到 (2.00.0.25) 二 医 


2.0 1.0 
92 ， (2.00, 0.25) = | | 。 


4.0 2.0 
The differentials Ap and Ad are solutions of the linear system 

20 10|1Ap| 10.25 

40 20|1Ao| 10.25|- 
Astraightforward calculation reveals that 

_ |Ap| | 0.09375 

人 一 [| = | 0.0625 | 

The next point in the iteration is 
2.00 0.09375 1.90625 
= 0+A 一 [33| 十 | 0.0625 | = 13 | 

Similarly, the next two points are 


1.900691 1.900677 
邱 一 1652 4 3 一 [人 


The coordinates of 己 3 are accurate to Six decimal places, Calculations for fnding P2 and 
P3 are Summarized in Table 3.7. 加 
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Table 3.7 “Function Values, Jacobian Matrices, and Differentials Required for Each 
Iteration in Newton's Solution to Example 3.32 






Solution of the linear system 
J(PK)AP 一 瑟 (Pi) 





忆 十 A 忆 


































2.0 1.0 0.09375 0.25 


加 [as- [3 





1.90625 


四 [ns 





1.90625 1.8125 1.0 0.005559 | ”0.008789 1.900691 
0.3125 3.8125 2.S 0.001287 | 10.024414 0.311213 
1.900691 1.801381 1.000000 0.000014| ”10.000031 1.900677 
0.311213 3.801381 2.489700 0.000006 | 10.000038 0.311219 








Implementation of Newton's method can require the determination of several par- 
tial derivatives、It is permissible to use numerical approximations for the values of 
these partial derivatives, but care must be taken to determine the proper step Size. In 
higher dimensions it is necessary to use the methods for solving linear systems intro- 
duced earlier in this chapter to solve for A 忆 . 


MATILAB 


Programs 3.6 (Nonlinear Seidel Iteration) and 3.7 (Newton-Raphson Method) will re- 
quire saving the nonlinear System 下 一 G(X), and the nonlinear System 下 (X) 一 0 
and its Jacobian matriX,， JP, Tespectively, as M-files. As an example consider saving 
the nonlinear System in Example 3.32 and the related Jacobian matrix as the M-hiles 
FE.nand JF .m, respectively. 


function Z=F(X) function W=JF(X) 
X=X(1) ;y=X(2) ; X=X(1) ;3y=X(2) ; 
Z=zeros(1 ,2) W= [2*+x-2 -1;2*X 8ky] ; 


Z(1)=x7"2-2*+Xx-y+0.5; 
Z(2)=x>-2+4y ”2-4; 


The functions may be evaluated using the standard MATLAB commands. 
>>A=feval('FE', [2.00 0.25]) 
A= 
0.2500 0.2500 
>>V=JEF([2.00 0.25]) 
也 = 
2 -1 
4 2 
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Program 3.6 (Nonlinear Seidel Iteration)， To solve the nonlinear fixed-point 
System 下 一 CG( 瑟 )， given one initial approximation 忆 o, and generating a Sequence 


{ 尼 牛 that converges to the solution 己 . 





function [P,iter] = sejidel(G,P,dqelta，maxl) 


%Input ~ G is the nonlinear System Saved in the M-file 6 .了 
包 - P is the initial guess at the solution 

六 - delta is the error bound 

从 - max1l is the number of Iterations 

XDutput - P is the seidel apPproximation to the Solution 

为 -~ iter is the number of iterations required 


N=length(P) ; 
for X=1 :maX1 


又 =P ; 
%X is the kth apProximation to the solution 
Eor j=1:N 


A=feval(2G:，,X) ; 
y Updaate the terms of X as they are calculated 
X(j)=A(j) 
end 
err=abs(norm(X-P) ) ; 
TelerTr=err/ (norm(X)+eps) ; 
P=X; 
Iter= 区 ; 
if(err<delta) | (relerr<delta) 
breaK 
end 
end 


In the following program the MAILAB command AN\B is used to solve the linear 
System 4 于 一 用 (see Q=P-(JNY:) ). Programs developed earlier in this chapter could 
be used in place of this MATLAB command. The choice of an appropriate program 
to Solve the linear System would depend on the Size and characteristics of the Jacobian 
ImatrixX. 


Program 3.7 (Newton-Raphson Method). To solve the nonlinear system 


(4) = 0， given one initial approximation Po and generating a sequence { 疡 中 
外 at converges to the solution 忆 . 





function [P,iter,err]=newvdim(F,JF,P,delta,epsilon,max1) 


hkInput -了 下 is the system saved as the M-file 下 .m 
为 -~ JEF is the Jacobian of F saved as the M-file JF.M 
久 -~ P is the initial approximation to the solution 
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世 -~ delta is the tolerance for P 

% - epsilon is the tolerance for F(P) 

4 - maxl Is the maximum nunber of iterations 
xDOutput - P is the approximation to the solution 

攻 -~ iter is the Dumber of iterations required 
% -~ err is the erIor estimate for P 


Y=feval (了 ,P) ; 

for X=1:max1l 
J=feval(JF,P) ; 
Q=pP-(JNY?)，; 
Z=feval(F,Q) ; 
erTr=norm(Q-P) ; 
relerr=erTr/ (norm(Q)+eps) ; 
P=Q; 
Y=2Z ; 
Iter=K; 
诺 (err<delta) | (relerrcdelta)|(abs(Y)<epsilon) 

break 

end 

enaQ 


了 Pxercises for Iteration for Nonlinear Systems 


1.、Find (analytically) the fxed point(s) for each of the following systems. 
(az=8IG 人 =x 7 
yy 二 8,y) 一 十 6y 
四 zx=8IGC 力 = 人 2 3)/3 
7y=8Cy7) 一 (x+y 1/3 
(中 xx 工 = 一 SC,y) 一 sin(y) 
?=8C 作 = 6x 十 》 
(Ji xz=8SIGC 7 ZJ 一 9 37 2z 
yy 一 82( ,yz 一 2 工 十 Z 
z 一 83(0,y,Z) 王 9+3x 十 47 z 


2。Find (analytically) the zero(s) for each of the following systems. Evaluate the Jaco- 
bian of each system at each zero. 


(aj 0= 廊 ,人 =2x 十 7》 6 
0= 户 (xy)=XZ 十 2 

(0= 户 (c,=3xr2 二 27 4 
0= PPx,y)=2x 十 27 3 
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Eigure 3.7 The hyperbola and 
circle for Exercise 人. 





(人 0= 凡 Co 人 =2x 4cos(y) 
0= 户 (x,y)=4xrsin(y) 

(D 0=Gyz)= 妇 十 天 
0= 户 (cy,z) 一 X2 十 2 十 2 1 
0= 有 户 C》z)=X 十 》 


Find a region in the xy-plane Such that 让 (po,9o) is in the region then fixed-point 
iteration is guaranteed to converge (use an argument simjlar to the one that followed 
Theorem 3.17) for the system: 


X=SO 人 = 六 3)/3 
7 一 820, yy) 一 ( 余 十 y 十 1)/3， 


Rewrite the following linear System in fxed-point form. Find bounds on x，y, and > 
such that fxed-point iteration is sure to converge for any initial guess (p0, go, ro) that 
satisfies the boundary conditions. 


6x 二 y 十 z=1 
X 十 4 十 Z 一 2 
X 十 7y 十 $z 一 0 


For the given nonlinear system, use the initial approximation (po, go) = (1.1, 2.0)， 
and compute the next three approximations to the fxed point using (a) fxed-point 
iteration and equations (14) and (b) Seidel iteration using equations (18)， 


8z 4xr2 十 只 +1 
8 
2x 2 十 47》 只 十 3 
4 


X 一 8S10Cc,y) 一 (hyperbola) 


一 82(x,y) 三 (circle). 
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Figure 3.8 The cubic and porabola 
for Exercise 6. 





6。For the following nonlinear system, use the initial approximation (p0, go) = ( 0.3， 
1.3), and compute the next three approximations to the fxed point using (a) fxed- 
point iteration and equations (14) and (b) Seidel iteration using equations (18). 


3 3 2 3 
X 一 BIO y) 二 一 一 一 (cubic) 
2 
十 2 X 2 
> 三 82(Cx,y) 一 一 一 (parapbola). 


7。Consider the nonlinear System 


0= ho 人 =z 》 02 
0 一 户 ( 二 六 X 0.3. 


These parabolas intersect in two points as shown in Figure 3.9. 


(a) Start with (po, go) = (1.2, 1.2) and apply Newton's method to compute (P1,91) 
and (P2, 92). 


人) Start with (po, go) = ( 0.2，0.2) and apply Newton's method to compute 
(P1,91) and (p2, 92). 


8. Consider the nonlinear System shown in Figure 3.10. 


0= ho 人 =2+ 刀 2 
0= 户 wy)=Xy 上 | 


(a) Verify that the solutions are (1,1) and( 1， 1)， 
(b) What diffticulties might arise 计 we try to use Newton's method to find the solu- 
tions? 


9. Show that Jacobi iteration fora 3 x 3 linear system is a special case of fxed-point 
iteration (19)， Furthermore, verify that if the coefficient matrix froma3 x 3 linear 
System is strictly diagonally dominant then condition (17) is satisfied. 


广 ; 


SEC， 
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Figure 3.9 ”The parabolas for KEigure 3.10 The circle and hyper 
Exercise 7. bola for Exercise 8. 
10. Show that Newton's method for two eqduations can be written in fxed-point iteration 


1 . 


form 


工 一 SIC,y)， ?了 =82(x，y)， 


Where 8S1(Cx,y) and 82(x,y) are given by 


态 Cc 中 功 户 Cr 六 户 G 训 有 Gy 
det(7 Ce， 7)) 
户 C 人 是 月 G 人 Ge 妨 让 户 CrJ 
det(y7 xy)) 
Fixed point iteration is used to solve the nonlinear System (12)，Use the following 


steps to prove that conditions in (16) are sufficient to guarantee that {(Pk, 9k)} con- 
Verges to (P,9g). Assume that there is a constant 玉 withO < 天 < 1 so that 


Si y) 一 并 


8S2(C,y) 一 》 


< 天 











0 0 

一 SI yy) 十 | 一 SI 力 
dx ay 

and 


< 天 








8 8 
二 ee 十 1 记 ec 妇 ) 


for all (x, y) in the rectangleR= {oy) :aa<xy<pbco<y<d. Alsoassumne 
thata< pp<pandc<do<d Petine 


一 PP PPM， 了 = 和， and 下 =maxfilekl| 友 引 ， 
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Use the following form of the Mean Value Theorem applied to functions of two vari- 
ables: 


0 灾 0 来 
三 一 ， 十 一 ， 五 
ek+1 元 SLC GK)eK 了 81 Ck) 五 


8 8 _ 
k+1 一 贡 82 人 bi Gdk)ek 十 现 22(P, 4 


where ak and px lie in [a,D] and cx and ax lie in fc, d]. Prove the following: 
(alell 和 天 roand|E1I| 三 天 mo 

(lez| < 天 rl 三 天 27o and | 有 2| < 天 r < 天 270 

(9 lekl 荆 天 re 三 天 kro and Et < 天 rr 1 < 天 470 

(lim 一 oo 下 天 Pandlimn oo 和 一 4 

As noted earlier, the Jacobian matrix of System (20) is the two-dimensional analog 
of the derivative，Write System (20) as a vector function Y 一 下 ()，and let 7(F) 


be the Jacobian matrix of this system. Given two nonlinear Systems Y 一 不 ( 刁 ) and 
TY=C(X)andthe real number c, prove: 


(BJCF(Sh) 一 CCF (人 )) 
(D) JEQGOIT+TGG))=JEG))+JOGOGD)) 


12 


Algorithms and Programs 





1，Use Program 3.6 to approximate the fxed points of the systemas in Exercises $ and 6. 
Answers Should be accurate to 10 decimal places. 


2. Use Program 3.7 to approximate the zeros of the Systems in Exercises 7 and 8. An- 
SWers Should be accurate to 10 decimal Places. 


3.。Construct a program to find the fxed points of a system using fxed-point iteration. 
Use the program to approximate the fixed points of the systems in 也 xercises 5 and 6， 
Answers should be accurate to 8 decimal places， 


4. Use Program 3.7 to approximate the zeros of the following systems. Answers should 
be accurate to 10 decimal places. 


(0= 闻 x+ 十 2 二 22 5 
0= 妇 十 妨 ?十 到 4 
0=z2 十 2+z2+z 6 

人 ) 0=z x+2y2+yz 10 
一 xz 67 十 7 


0 
0 

人 0=(G+HDz+OT+D2 > 
0 


= D2+ 闪 > 
0=4xr2 十 22 十 2 16 


-一 -一 


SEC. 3.7 ITERATION FOR NONLINEAR SYSTEMS 18S 


(上 ) 0=9x2 十 362 十 4z2 36 
0 一 2 2? 20z 
0=1l6xz 2 妇 272 16z? 
S，We Wish to solve the nonlinear System 


0=7z3 lox y 1 

0=873 1ly 上 +x 1 
Use MATLAB to sketch the graphs of both curves on the same coordinate System 
Use the graph to verify that there are nine points where the graphs intersect，Using 


the graph, estimate the points of intersection. Use these estimates and Program 3.7 to 
approximate the points of intersection to 9 decimal Places， 


6、The System in Problem 5 can be rewritten in fixed-point form: 


3 ? 1 
“一 0 

本 873H+xr 1 

本 11 


Do some computer experimentation， Discover that no matter what starting value is 
used, only one of the nine solutions can be found using fxed-point iteration (on this 
particular fxed-point form), Are there other fxed-point forms of the system in S that 
could be used to find other solutions of the system? 





Interpolation and 
Polynomial 人 Approximation 


Thbe computational procedures used in compnuter software for the evaluation of a 1li- 
brary function, such as Sin(x), cos(x), or ex, involve polynomial appproximation. The 
state-of-the-art methods use rational functions (which are the quotients of polynomi- 
ais)、 However the theory of poliynomial approximation is suitable for a first course 
in numerical analysis, and we will mainly consider them in this chapter Suppose that 
the function Foxc) = ex is to be approximated by a polynomial of degree 7 王 2 over 
the interval [| 1, 1]. The Taylor polynomial is shown in Figure 4.1(a) and can be con- 





-1.0 -0.5 0.0 0.5 1.0 
(q) ) 


Figure 4.1 (a) The Taylor polynomial Pp(x) 三 1.000000 十 1.000000x 十 
0.500000x? which approximates /xx) = er over [ 1 1. (b The Chebyshev 
approximation 4(x) = 1.000000 十 1.129772x 十 0.532042x2 for F(x) 一 ex over 
上 二 ]. 
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了 
6 
5 ?= PoD 
4 
3 
2 
1 Figure 4.2 The graph of the col- 
jocation polynomial that passes 
7 _ through (1, 2)，(2, 1)，(3, 53)，(4, 6)， 
1 2 3 4 5 and (5, 1]). 


trasted with the Chebyshev approximation in Figure 4.1(b).， The maximum error for 
the Taylor approximation is 0.218282, whereas the maximum error for the Chebyshev 
polynomial is 0.056468. In this chapter we develop the basic theory needed to investi- 
gate these matters. 

An associated problem involves the construction of the collocation polynomial, 
Given 7 十 1 points in the plane (no two of which are aligned vertically), the colloca- 
tion polynomial is the unidque polynomial of degree < mthat passes through the points. 
In cases Where data are known to a high degree of precision, the collocation polyno- 
mial is sometimes used to find a polynomial that passes through the given data points. 
A variety of methods can be used to construct the collocation polynomial: solving a 
linear System for its coefficients, the use of Lagrange coefficient polynomials, and the 
construction of a divided differences table and the coeffcients of the Newton poly- 
nomial. All three techniques are important for a practitioner of numerical analysis to 
know. For example, the collocation polynomial of degree 2 一 4 that passes through 
the five points (1, 2), (2, 1), (3, 5), (4, 6), and ($, 1 is 


Sx4 82x3 十 427x2 806x 十 504 
24 ! 


and a graph showing both the points and the polynomial is given in Figure 4.2. 


PP(G) 一 


Tayior Series and Calculation of Functions 


Limit processes are the basis of calculus. For example, the derivative 
.x+h oo 
(和 门 一 lim 二 一 -一 一 

1 0 一 1 天 


is the limit of the difference quotient where both the numerator and the denominator 
go to zero. A Taylor series illustrates another type of limit process， Im this case an 
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Table 4.1 Taylor Series Expansions for Some Cormmon Functions 


3 -5 7 
、 大 基 其 
Sin(X) 一 X 可 十 可 万 十 forall x 
2 ,4 -6 
关 放 大 
Cos(xr) 一 1 到 十 而 可 十 全 for all x 
2 3 4 
一 十 
e =1 十 x 十 机 十 [十 页 十 for all x 
In(L 十 z) 开 + 1<x<l 
mn X)=X 一 十 一 一 
2 3 4 一 
tan(x) 一 和 + 于 志 + 1<xzx<sl 
arctantx) 一 六 3 5 了 二 


1 1 2 
2 ) ,2 -PC 忆 ) ,3 |. 


infinite number of terms is added together by taking the limit of certain partial sums， 
An important application is their use to represent the elementary functions: sin(x)， 
cos(x),e jn(x),etc. Table 4.1 gives Several of the common Taylor series expansions，. 
The partial sums can be accumulated until an approximation to the function is obtained 
that has the accuracy specified.， Series solutions are used in the areas of engineering 
and physics， 

We want to learn how a finite sum can be used to obtain a good approximation 
to an infinite sum. For illustration we shall use the exponential series in Table 4.1 to 
compute the number e = el, which is the base of the natural logarithm and exponential 
functions, Here we choosex 一 1 and use the series 


1_1 1 了 工 芋 攻 
e 一 十 下 十 页 十 机 十 页 十 十 页 十 7 


The definition forthe sum of an infinite series in Section 1.1 requires that the partial 
sums SN tend to a limit, The values of these sums are given in Table 4.2. 

A natural way to think about the power sefies representation of a function is to 
view the expansion as the limiting case of polynomials of increasing degree. If enough 
terms are added, then an accurate approximation will be obtained，This needs to be 
made precise， What degree should be chosen for the polynomial，and how do we 


calculate the coefficients for the powers of x in the polynomial? Theorem 4.1 answers 
these questions， 
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Table 4.2 Partial Sums 9，Used to 
Determine e 











onmwmib 口 


2.5 


2.6060660666066 ... 
2.708333333333 . .. 
2.716666666066 ... 
2.71803S5535355 ... 
2.718253968254 . ,， 
2.718278769841 . .. 
2.718281525373 .. . 
2.718281801146 ... 
2.718281826199 . .， 
2.718281828286 . .. 
2.718281828447 . . . 
2.718281828458 ... 
2.718281828459 .,. 
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Theorem 4.1 (Taylor Polynomial Approximation)。 Assume that As CN+1[a,D] 
and xo ec [a,p]is a fxed value. fx e [c,p],then 


(D) J ce) = PCz) 十 EN(Cxz)， 


where PN (x) is a polynomial that can be used to approximate 三 (x): 


N_ Ar(O 
O) Jo 六 m= 0。 六 
The error term 瑟 N(x) has tbhe form 
(Nt+D(e) 
G) EN(xr) 一 FITCG X0) + 


for some valuec = CCx) that lies between x and x0， 


Proof The proof is left as an exercise. 


Relation (2) indicates how the coefficients of the Taylor polynomial are cajculated. 
Although the errorterm (3) involves a similar expression, notice that 太 (VY+D(c) is tobe 
evaluated at an undetermined number c that depends on the value of x. For this reason 
We do not try to evaluate 有 N(x): it is used to determine a bound for the accuracy of 


the approximation. 
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Example 4.1.， Show why 15 terms are all that are needed to obtain the 13-digit approxi- 
matione 一 2.718281828499 in Table 4.2. 

Expand Fr) = ex in a Taylor polynomial of degree 1S using the fxed value xo 三 0 
and involving the powers (xf 0) 一 xx， The derivatives required are PCxz) = (xc) = 
.一 FI0 = er. Thefirst 1 derivatives are used to calculate the coefficients ak 一 e0/ 有 
and are used to write 


| Pi | 本 
人 1 15 

Settingx = 一 1 ip(4) gives the partial sum 415 三 Pi5(1). The remainder term is needed to 
show the accuracy of the approximation: 


16(cxle 


(3) 开 15(x) 一 16I 


Since we chose xo 三 0andx 一 1thevaiue c les between them (ie.,0 < c < 1), which 
implies that ec < el. Notice that the partial sums in Table 4.2 are bounded above by 3. 
Combining these two inequalities yields e“ < 3, which is used in the following calculation 


06) < 3 
Le | < 1.433844 x 10 13， 


15(1)| 一 
121s 人 1) 16 16 ”16 





Therefore, all the digits in the approximation e 妆 2.71828182845S9 are correct, because the 
actual error (whatever it is) must be less than 2 in the thirteenth decimal place. 国 


Jnstead of giving a rigorous proof of ITheorem 4.1, we shall discuss some of the 
features of the approximation; the reader can look in any standard reference text on 
calculus for more detaits，For illustration，we again use thbe function (xzx) = ex and 
the value x0 = 0、From elementary calculus we know that the slope of the curve 
yy 一 ex atthe point (kx,exr) is 产 (x) = er，Hence the slope at the point (0, 1) is 
(0) = 1. Therefore, the tangent line to the curve at the point (0, D) is y = 1 十 工 . 
This ls the same formula that would be obtained if we used N = 1 in Theorem 4.1， 
that is, 户 (xz) = 0) 十 P(O)x/1 = 1 十 x. Therefore, P(xz) is the equation of the 
tangent line to the curve. The graphs are Shown im Figure 4.3. 

Obsetve that the approximation ez 久 1 十 x is goodnear the center x0 = 0 and that 

.the distance between the curves grows 3S x Imoves away from 0. Notice that the Slopes 
of the curves agree at (0, 1). In calculus we learned that the second derivative indicates 
whether a curve is concave up or down. The study of curvaturel shows that 让 two 
curvesy = jx) andy = 8(xz) havethe property that /Coxo) = 8(xzo)， (xzo) = 8 (xzo)， 
and (xzo) 三 8"(xo) then they have the same curvature at x0. This property would be 
desirable for a polynomial function that approximates F(x). Corollary 4.1 shows that 
the Taylor polynomial has this property for N > 2， 


1The curvature Kof a graph y = /xz) at (xzo, yo) is defined by 天 = | J7Co)HMGLT[LPGo)]2)3/72. 
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Figure 4.3 The graphs of y 一 ex 
andy 一 已 (xx) 王 1 十 1 





Corojllary 4.1， II Pw(x) is the Taylor polynomial of degree N given in Theorem 4.1， 
then 


(6) PW(xo) = F(xo) for 大 =0 1 ...，N. 


Proo Setx = xoinequations (2) and (3), and the resujt is_Pv (xzo) = zxo). Thus 
statement (6) is true forK 上 一 0. Now differentiate the right-hand side of (2) and get 





) (十 1) 
(7) PWGoD) = 冯 Se -人 j ou 本 
一 0 局 


Setx = 20 让 (7) to obtain Pw(xo) 一 太 (xo). Thus statement (6) is true for 有 王 1. 
Successive differentiations of (7) will establish the other jdentities in (6). The details 
are left as an exerclse. ee 


Applying Corojllary 4.1, we See that y 王 忆 (xz) has the properties 丰 (x0) = 严 (0)， 
Co) = 户 (xoj, and AP (xzo) = 户 '(Cxo);i hence the graphs have the same curvature 
at x0. For example, consider fk) = er and Pr) = 1 十 x 十 x2/2. The graphs are 
Shown in Figure 4.4 and it is seen that they curve up in the same fashion at (0, 1). 

In the theory of approximation, one seeks to find an accurate polynomial approx- 
imation to the analytic function2 (xz) over [a, b]. This is one technique used in de- 
veloping computer software. The accuracy of a Taylor polyaomial is increased when 
we choose N large. The accuracy of any given polynomial will generally decrease as 
the value of x moves away from the center x0. Hence we must choose N large enough 
and restrict the maximum value of lx xzx0| so that the error does not exceed a specified 
bound. If we choose the interval width to be2R and xo inthe center (ie.,|x xol < 愉 )， 


2The function xc) it analytic at x0 if it has continuous derivatives of all orders and can be 
Tepresented as a Taylor series in an interval about x0. 


一 一 一 一 一 一 一 一 一 一 一 - 
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Figure 4.4 The graphs of y = ez andy 三 已 (x) =1 十 
x 十 X212. 


Table 4.3 Values for the Error Bound error| < e&RXwT+LI/CV 二 TDIUsing the 
Approximation ex 之 PN(xz) for|x| 和民 


玉 一 2.0， 玉 一 1.S， 
lxl < 2.0 lxl < 1.5 




























ex 必 P5(X) 0.65680499 0.07090172 0.00377539 0.00003578 
E 人 站 (CC) 0.18765857 0.01519323 0.00053934 0.00000256 
E@4 久 甩 (r) 0.04691464 0.00284873 0.00006742 0.00000016 


ex 已 属 (0) 0.01042548 0.00047479 0.00000749 0.00000001 





the absolute value of the error satisfies the relation 


N+1 
8 一 五 < 一 一 一 一 一 ， 
(8) |error| = |ENGCoD)| < TU 
where M < maxfj ANW+D(z)l :xzo 尺 <z< X0 十 RR). 开 N is fxed andthe derivatives 
are uniformly bounded, the error bound in (8) is proportional to RN+LI/CN + Diand 
decreases 计 尺 goes to zero as N gets large. Table 4.3 shows how the choices of these 
two parameters afifect the accuracy of the approximation ex APN(x) overthe interval 
|xl < 尺 . The error is smallest when N is largest and Rsmallest， Graphs for 忆 ， 启 
and 有 are given in Figure 4.5. 


? 


Example 4.2.， Establish the error bounds for the approximation ex s% Pe(xz) on each of 
the intervals |x| < 1.0 and | xl < 0.5. 
Iflxl < 1.0,thenletting 尺 = 10andlF9(ol=lec<el0=Min(8)implies that 
el0(1.0)? 


|error| = |Es(x)| 芭 一 说 0.00000749. 
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1 2 
Figure 4.$S The graphs of y 一 er,y 王 户 (,y = 户 ()， 
and y 一 疡 (zx). 
了 





YY Figure 4.6 The graph of the error 
y=Eo0) 三 6 古 00)， 


Iflxzl < 0.$,thenletting 尺 =0.5and|Fo9)(c)|=|lecl| <e05 = Min(8)implies that 


jerror| 一 1E8(Gxc)| < 2 0.00000001. 四 


e0.5 (0. S)9 
9! 
Example 4.3， If 六 (xz) = ex show that N 一 9is the smallest integer so that the |error| 一 
[EN(C)| < 0.0000005 forx iE[ 二 1]. Hence 户 (x) can be used to compnite approximate 
values of ex that will be accurate in the sixth decimal Place， 

We need to fnd the smallest integer N so tat 


四 ec(DA+i 
|error| = | 人 NGCxz)| 二 这 


In Example 4.2 we saw that N = 8 was too Small, so we try NV = 9 and discover 
that |EN(OD)l < elL(D)?+L/(9 二 DLL < 0.000000749. This value is slightly larger than 


< 0.0000005. 
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desired; hence we would be likely to choose N 王 10， But we used e5 < el as a crude 
estimate in fnding the error bound，Hence 0.000000749 is a little larger than the actual 
error, Figure 4.6 shows a graph of Eo(xz) 一 er Pt). Notice that the maximum vertical 
range is about3 x 10 7 and occurs at the right end point (1,，Eoe(1)). Indeed, the maximum 
error on the interval is FEo(1) = 2.718281828 ”2.718281526 s 3.024 x 10 7. Therefore， 
AN =9isjustified. 和 


Methods for Evaluating a Polynomial 


Thbere are several mathematically equivalent ways to evaluate a polynomial, Consider， 
for example the function 


(9) Foo0 = 1 


The evaluation of 三 will require the use of an exponential function， Or the binomial 
formula can be used to expand (zx) in powers of x: 


8 
8 

(10 7z) 一 (中 4( 1 六 

) /on 包 

一 妇 8r 二 28x6 56x5 二 70x4 56x3 十 28z2 8x 十 1. 

瑟 orzers mietiod (See Section 1.1)，which is also called mested mxlkipizcator，can 
now be used to evaluate the polynomial in (10). When applied to formula (10), nested 
multiplication permits us to write 


(11) Ga)=((( 人 (xx 8)x+28)x SS6)x 十 70)x 5S6)x 十 28)x 8)x 十 1 


To evaluate j(xz) now requires seven multiplications and eight additions or sub- 
tractions，The necessity of using an exponential function to evaluate the polynomial 
has now been eliminated. 


We end this section with the theorem that relates the Taylor series in Table 4.1 and 
the Taylor polynomials of Theorem 4.1. 
Theoreim 4.2 (Iaylor Series)._ Assume that F(x) is analytic and has continuous 


derivatives of all order N = 1, 2, . ..,on an interval (a, p) containing x0. Suppose that 
the Taylor polynomials (2) tend to a limit 


人 天) 
。 。 上 (x0) 天 
12 SI) 一 lim 己 一 一 一 一 一 
(12) Co0= im weo0O= im 包 RE CC 2) ， 
then (xz) has the Taylor series expansion 


co、F(O) 
(3) j 加 = 入 一 和 0 六 
大 =0 “ 
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Proof This follows directly from the definition of convergence of series in Sec- 
tion 1.1，The limit condition is often stated by saying that the error term must go 
to zero as N goes to infinity. Therefore, a necessary and sufficient condition for (13) 
to hold is that 


fot+ cz 


4 lim 三 = limn 一 一 一 一 一 一 一 二 0， 
44) NI NG) No (N 十 了)! ! 
where c depends on N and 7x， @ 


卫 xercises for Taylor Series and Calculation of Functions 





1 Let jx) = Sin(x) and apply Theorem 4.1. 
(a) Usexo 一 0andfind Ps(x), 杨 (xz), and Po(x). 
(b) Show that 让 lx 和 1thenthe approximation 
。 因 X3 X5 X7 X9 
0 本 可 
has the error bound |Eo(xz)| < 1/10! < 2.75574 x 10 “. 
(Cj) Use xzo 一 T/4andfind 卢 (x), which involves powers of (x 立 /4). 
2.Let fx) = cos(x) and apply Theorem 4.1. 
(al) Usexo 一 0andfnd Ps(x)，Pz5C),and 疡 (x). 
(pb) Show that if jx| < 1 then the approximation 


X2  X4 X6 2X8 


Cos(xz) 久 工 歹 十 页 可 十 可 
has the error bound |Eg(x)| < 1/9! < 2.7S$74 x 10 6. 
人 (c) Use xo 一 T/4andfind Pi(x), which involves powers of (x “元 /4)， 
3. Does Ge) = xl have a Taylor series exbpansion about xo 一 0? Justify your answer 


Does the function 1 (xz) = xl12 have a Taylor series expansion about xo = 1? Justify 
your anSwer. 


4. (a) Find a Taylor polynomial of degree N = 5 for /xc) = 1/(1 +x) expanded 
about xo = 0. 
(b) Find the error term Es(xr) forthe polynomial in part (a). 
S. Find the Taylor polynomial of degree N = 3 for Flx) = e xz/2 expanded about 
2X0 一 0. 


6. Find the Taylor polynomial of degree N = 3, 户 (zj, for Fr) = x3 2x2 十 27 
expanded about x0 = 1. Show that xz) = 户 (z). 
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10. 


12. 


13. 
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.。(a] Find the Taylor polynomial of degree N = $ for Fo) = xl/2 expanded about 


X0 三 4， 

(bj Find the Taylor polynomial of degree N = $ for oo = xl1/2 expanded abonut 
X0 一 9. 

(cj) Determine which of the polynomials in parts (a) and (b) best approximates 
(6.5)“. 


。 Use F(x) = (2 十 z)112 and apply Theorem 4.1. 


(a) FEind the Taylor polynomial 户 (x) expanded about xo = 2. 
(b) Use 忆 (x) to find an approximation to 31/2. 


(cj) Find the maximum value of | 了 (4) (c)| on the interval1 < c<3andfind abound 
for | 五 3(x)|. 


。Determine the degree of the Taylor polynomial PN (xz) expanded about xzo 王 0 that 


should be used to approximate e0.1 so that the error is less than 10 6. 


Petermine the degree of the Taylor polynomial PNw(x) expanded about xo 一 that 
should be used to approximate cos(33r/32) so that the error is less than 10 6. 


。(a) Find the Taylor polynomial of degree N = 4 for Fr) 一 “ cos(t2) df ex- 


panded about xzo = 0. 
(bp) Use the Jaylor polynomial to approximate 严 (0.1)， 
(cj Find a bound on the error to the approximation in part (b). 


( 世 Use the geometric series 


] 


一 一 1 x+x4 xz6+x8 .. for |x| < 1， 
工 十 x2 


and integrate both sides term by term to obtain 


3 


万 天 
arctan(X) 一 革 本 十 


S 了 
本 一 


区 
可 十 和 …: for jxl < 1 


(Use r/6 = arctan(3 LU2) and the series in part (a) to show that 


3 1 3 ?2 3 3 3 4 
=3M2x211 一 + -~ 二 二 ... 。 
机 “ 本 + 了 了 + 


(c) Use the series in part (b) to compute Tr accurate to eight digits. 
Fact. 六 交 3.141$926S3589793284 ..,. 


Use Je) = ln(] 十 xz) and xo = 0, and apply Theorem 4.1. 
(aj Show that j 昌 (=( De IE DDAG 二 zk 
(b) Show that the Taylor polynomial of degree N is 


大 4 ( 1 1xN 
2 


X3 
己 一 -一 -一 … 
N (CC) 一 革 十 本 下 十 十 六 
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14. 


(c) 


(gd) 
(9 
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Show that the error term for PN (x) is 
(《 TDwWxw+l 


DG 


Evaluate 饭 (0.9)，P6(0.$), and Po(0.3). Compare with ln(1.S). 
Show that 让 0.0 < x < 0.3 then the approximation 


2 X3 7 


放 
1 必 -- 一 一 .，--. 一 一 
n(x) 之 郑 二 十 本 十 了 


has the error bound.|5o9| 和 0.00009765 . . .. 


Binomial senres. Let 让 x) = (1 二 x)P andxo = 0. 


(a) 
(b) 


(c) 


(d) 


(e) 


人 


Show that fo) 一 PP 了 TD.…(P 十 DGI+zOP 大 
Show that the Taylor polynomial of degree N is 


1)x2 1)..， N 二 TDxN 
PtD=1+mr+P + 


Show that 
EC)=pPP 1D…(P NMNxw+i/(+cx+l PCON +10D. 


Set D = 1/2 and compnute 己 (0.3)， 忆 (0.3),， and 疡 (0.3)， Compare with 
(1.5)12. 


Show that 让 0.0 <x < 0.$ then the approximation 


2 3 Sx4 7Tx5 

1+mUV2Nw1+Z 工 + 二 2 

代 十 3 + 下 6 

has the error bound | 天 5| 芭 (0.5)6(21/1024) 一 0.0003204 .... 
Show that 让 = N is a positive integer, then 


NCN  Dx2 
一 Na 1 十 xA， 


Notice that this is the famijliar binomial expansion. 


PNvx) 王 1 十 Nx 十 


1S. Find c such that | 下 4| < 10 6 whenever |x  x0| < c， 


16. 


(3) 


(b) 


(9 
(3a) 


(b) 


Let 丰 (x) = cos(x) and xo = 0. 

Let /(x) = sin(Cxz) and xzo = 一 T/2. 

Let fx) 三 ex andxzo 一 0. 

Suppose that y》 一 j(x) is an even function (ie., jx) 一 fx)forallxinthe 
domain of 六 . What can be said about PN (xz)? 


Suppose that y = Fr) is an odd founction (ie., f( zz) = px)foralxipnthe 
domain of 方 . What can be Said about PN (xz)? 
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17. Let y = /(x) beapolynomial of degree N. If Fo) > 0and 广 (xo),，...， 太 (V) (x0) 盖 
0, Show that all the reajl roots of jare less than x0， 于 nt Expand 广 in a Taylor 
polynomial of degree N about x0. 


18.， Let Fox) = ef ，Use Theorem 4.1 to find Pr), for N = 1, 2, 3,...，expanded 
about xo = 0. Show that every real root of PN (xz) has multiplicity less than or equal 
to one. Note. HP is aroot of multiplicity M of the polynomial P(xz),then p is a root 
of multiplicity M 1of P (xz). 


19，Finish the proof of Corollary 4.1 by writing down the expression for PN (x) and 
showing that 


POoo) = WCGo for 大 =2, 3 ...，N. 


Exercises 20 and 21 form a proof of Taylor's theorem. 


20. Let 8() and its derivatives 8 人 1)， for 大 一 1, 2,...，N 十 1,be continuous on the 
interval (a, ) ,which contains x0. Suppose that there exist two distinct points x and 
X0 Such that 8(x) = 0, and 8(x0) 一 8'Cxo) 一 ...8gW)(ro) = 0 Prove that there 
exists a value c that lies between xo andx such that gtw+D(c) = 0. 

Remark. Note that g() is a function of !, and the values x and xo are to be treated 
as constants with respect to the variable /. 

nl Use Rolle's theorem (Theorem 1.$S，Section 1.1) on the interval with end 
points xo and x to find the number cl such that 8g'(cl) = 0. Then use Rolle's theorem 
applied to the function 8/() on the interval with end points xo and cl to find the 
number c2 such that 8"(c2) = 0 Inductively repeat the process until the number 
CN+1l is found such that g(N+U(cw+1) = 0. 


21， Use the result of Exercise 20 and the special function 


(人 Xo)wN+1 


SO 天) Pr(OD) Eve) NTT 


where PC is the Taylor polynomial of degree N，to prove that the error term 
EN) 一 Fox) Pr)hasthe form 


(x XO)N+1 


_ PCN+D 
ENG) 三 上 (C) TDr 


Ent Find g(N+D(D) and evaluate it at 上 一 c. 


Algorithms and Programs 
ee | 


The matrix nature of MATLAB allows us to quickly evaluate fnctions at a large num- 
ber of values. If X=[-1 0 , then sin(X) will produce [sin(-1) sin(0) sin(1)7]， 
Similarly, 这 X=-1;:0.1:1,then Y=sin(X) will produce a matrix Y of the same dimension 
as X With the appropriate values of sine. These two row matrices can be displayed in the 
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form of a table by deftining the matrixD = [X， Y)] (Note. The matrices X and Y must be 
of the same length.) 
1 (a) Use the plot command to plot Sin(x)，P5 (0 杨 (x), and 韦 (r) from Exercise 
l on the Same graph using the Interval 1 <x 芭 1. 
(pb) Create a table with columns that consist of sin(x)， 上 放 (x)， 记 (and Po(x) 
evaluated at 10 equally spaced values of x from the interval f 1, 1]. 


2. (a) Use the plot command to plot cos(x), 疡 (xz),， 疡 (xz), and 郊 (x) from Exercise 
2on 由 e same graph using the intervatl 1T<x< 1 
(b) Create a table with columns that consist of cos(x)，PC)，Pk(Gz)。 and PCx) 
evaluated at 19 equally spaced values of x from the interval [ 1 , 品 . 


JIntroduction to Interpolation 


In Section 4.1 we Saw how a Taylor polynomial can be used to approximate the func- 
tion /xx)，The information needed to construct the Taylor polynomial is the value 
of 太 and its derivatives at x0. A shortcoming is that the higher-order derivatives must 
be known, and often they are either not available or they are hard to compute. 

Suppose that the function y 三 /oo) is known at the N 二 1 points (xo, yo)，. ..， 
CN, yN)， where the values xx are spread out over the interval [a, p] and satisfy 


QQ<X0O<XI< <xYw<D and 欢 王 Coco). 


A polynomial P(x) of degree N will be constructed that passes through these V 十 1 
points. In the construction, only the numerical values xx and 了 从 are needed. Hence 
the higher-order derivatives are not necessary，、The polynomial 已 (x) can be used to 
approximate 夏 (x) overthe entire interval [a, D]. However if the error function 五 (x) 一 
jx) Pr is required, then we wil need to know w+D(xz) and a bound for its 
magnitude, that is 


Mf = maxfl ff+DGJl:a <y < 有 


Situations in Statistical and scientific analysis arise where the function y = (xc) 
is available only at N 十 1 tabulated points (xk, 办 ), and a method is needed to approx- 
imate F(x) at nontabulated abscissas. If there is a significant amount of error in the 
tabujated values, then the methods of curve fitting in Chapter $ should be considered. 
On the other hand, if the points (xk,， X) are known to ahigh degree of accuracy, then 
the polynomial curve y 一 PP(x) that passes through them can be considered，When 
X0 < xY < xN, the approximation P(x) is called an zalerpoialed yafue、 开 either 
XY<X0OorXN <xX,then P(xz)is called an extrapoliated yalue. Polynomials are used to 
design software algorithms to approximate functions, for numerical differentiation, for 
numerical integration, and for making computer-drawn curves that must pass through 
specified points. 
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The tangent line 
y y has slope 己 "(4). 


2.0 (3.3, P(S.3)) 


(4, P(4) 





1 2 3 4 S 6 


Figure 4.7 ”(a) The approximating FEigure 4.7 (人 b) The approximating 
Polynomial P(x) can be used for inter- polynomial P(x) is differentiated and 
polation at the point (4, P(4)) and ex- P'(x) is used to find the slope at the in- 
trapolation at the point (3.$, P(S.3))， terpolation point (4,，P{(4)). 


Let us brieflty mention how to evaluate the polynomial P(x): 
(1) P(xr) 一 QNXAN 十 CN 1xX 1 十 .十 ao2x2 十 alx 十 0. 


Horner's method of synthetic division is an effcient way to evaluate P(x). The deriva- 
tive PC) js 


(2) P'C) = NaNx !+(NW la 1Ixw 2 十 .十 202x 十 al 
and the indefinite integral 7(x) = 三 P(xr) dx, which satisfies 7 (xz) = P(xz),is 








(3) 1 = 人 + 吕 二 


where C is the constant of integration. Algorithm 4.1 (end of Section 4.2) shows how 
to adapt Horners method to _P“ (xz) and 7(0z). 


Exampie 4.4. The polynomial P(x) = 0.02x3 十 0.2x2 0.4x 十 1.28 passes through 
the four points (1, 1.06)，(2, 1.12)，(3, 1.34)，and (5, 1.78)，Find (a) P(4)，(b) 己 "(4)， 
(C) 及 PC)dx, and (d) P(3.5). Finaly, (e) show how to find the coefficients of P(x)， 
Use Algorithm 4.1 人 G)-(iii) (this is equivalent to the process in Table 1.2) with x = 4. 

(3) 2p3 = 一 0.02 

2 一 42 十 px 一 0.2 二 ( 0.02)(4) = 0.12 

pl =a 十 px 一 04+(0.12)(4) = 0.08 

po=ao 十 px =1.28 十 (0.08)(4) = 1.60. 
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了 
2.0 
1.$ 
?= 已 2 

1.0 

0.5 
Figure 4.8 The approximating 
polynomial P(x) is integrated and 

0.0 x its antiderivative is used to find the 

1 2 3 4 $ 6 area Under the curve for 1 <x 三 4. 


The interpolated value is 已 (4) = 1.60 (see Figure 4.7(a)). 


(b) 史 三 3a3 = 0.06 
碳 一 2a 十 dx =0.4 十 ( 0.06)(4) = 0.16 
d=a+dx= 0.4+(0.16)(4) = 0.24. 


The numerical derivative is P"(4) = 0.24 (see Figure 4.7(b)). 


(O 和 4 一 了 = 0.005 
D 一 对 十 ax 二 0.06666667 十 ( 0.005)(4) = 0.04666667 


2 一 辽 十 1x = 0.2 二 (0.04666667)(4) 一 0.01333333 


站 = 二 ix=128 十 ( 0.01333333)(4) = 1.22666667 
io 一 0 十 x 一 0 十 (1.22006667)(4) = 4.906666067. 


Hence 7(4) = 4.90666067. Similarly, 7() 三 1.14166667，Therefore， 扩 P(r)dx 三 
T(4) 7(U) = 3.765 (see Figure 4.8). 
(d) Use Algorithm 4.1(D with x = .5， 


2p3=a 三 0.02 

D2 王 2 十 p3x 一 02 十 ( 0.02)(S.5) = 0.09 
Di=al+pxr 一 0.4 十 (0.09)(S.5) = 0.095 
po=ao 十 Pix 一 128 二 (0.095)($.5) = 1.8025. 


The extrapolated value is P(S.5) = 1.8025 (see Figure 4.7(a)). 
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Table 4.4 ”Values of the Taylor Polynomial 了 (x) of Degree S$, and the 
Function jn(1 十 x) and the Error ln(1 十 x) TOxz) on [0, 1] 



















f 
Taylor polynomial,， Function， Error， 

了 (x) ln(] 十 2z) ln(1 十 xz) 了 (zx) 
. 0.00000000 0.00000000 0.00000000 
0.2 0.18233067 0.18232150 0.00000911 
0.4 0.33698133 0.33647224 0.00050909 
0.6 0.47515200 0.47000363 0.00514837 
0.8 0.61380267 0.58778666 0.02601601 
1.0 0.78333333 0.69314718 0.09018615S 








(e) The methods of Chapter 3 can be used to find the coefBcients. Assume that P(x) 一 
4 二 Bx+Cxr2z 十 Dr3; then at each valuex = 12,3, and5 we get a linear equation 
involving 4, 有 ,Cand 万 . 


41z 一 1:4 二 18+ IC+ 1LD=1.06 
4IXY=2:4++2B+ 4C 二 8D=1.12 


4 
全 ) 4tr 一 3:4 二 3B+ 9C+ 27D = 1.34 
41X5 一 S:4 十 S$8 十 2SC 十 12SD = 1.78 
The solution to (4)i 4=1.28, 有 = 04,C=02,andD 一 0.2. 鲁 


This method for finding the coefficients is mathematically sound, but sometimes 
the matrix is difhcult to solve accurately. In this chapter we design algorithmas specifi- 
caliy for polynomials. 

Let us retur to the topic of using a polynomial to calculate approximations to a 
known fnnction，JIn Section 4.1 we Saw that the fifth-degree Taylor polynomial for 
丰 (Oxz) 一 In(l 十 xis 


艺 3 2X4 
(S) 了 (x) 一 X 三 十 本 于 十 本 ， 

开 了 (xz) is used to approximate ln(1 十 x) on the interval [0, 1], then the error is 0 at 
xx 二 0andislargest whenx 一 1 (see Table 4.4). Indeed, the error between T(1) and 
the correct value In(]) is 13%,， We Seek a polynomial of degree S that will approximate 
ln(1 十 x) better over the interval [0, 1]， The polynomial P(x) in Example 4.S is an 
interpolating polynomial and will approximate ln(] 十 x) with an error no bigger than 
0.00002385 over the interval [0, 1]. 


Cn 


了 Example 4.S， Consider the function j(Cx) = ln(1 十 zx) andthe polynomial 


P(r) = 0.02957206x5 0.1289529Sx4 十 0.28249626x3 
0.48907554x? 十 0.99910735x 
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Table 4.3 Values of the Approximating Polynomial P(x) of Example 4.5 and the Function 
jx) =In(1 二 xz) andthe Error 天 (xz) on[ 0.11.1] 


Approximating polynomial， 
己 (Cx) 










。 0.10509718 
0.0 0.00000000 
0.1 0.09328988 
0.2 0.18232156 
0.3 0.26237015 
0.4 0.33647224 
0.5 0.40546139 
0.6 0.47000363 
0.7 0.53063292 
0.8 0.58778666 
0.9 0.64184118 
1.0 0.69314718 


0.74206529 





0.6 y= In(1 + 加 


0.4 


0.2 





0.0 0.2 0.4 0.6 0.8 





1.0 


Function， 
xz) 王 In( 二 2) 


0.10536052 
0.00000000 
0.09531018 
0.18232156 
0.26236426 
0.33647224 
0.40546511 
0.47000363 
0.53062825 
0.58778666 
0.64185389 
0.69314718 
0.74193734 
























Error， 
ED) 一 Jo Pr) 


0.00020334 
0.00000000 
0.00002030 
0.00000000 
0.00000589 
0.00000000 
0.00000372 
0.00000000 
0.00000467 
0.00000000 
0.00001271 
0.00000000 
0.00012795 












Figure 4.9 The graph of y = 
X 了 了 (Cr)，which “lies on top”of the 
graph y = ln(l 十 2)， 


based on the six nodes xk 一 K/5 forK = 0, 1, 2, 3, 4, and 5. The following are empirical 
descriptions of the approximation P(x) s In(1 十 zx). 


1. POxk) = F(xr) at each node (see Table 4.5). 


2，The maximum error on the interval [ 0.1, 1.1] occurs atxy = 0.1 and |error| 苹 
0.00026334for 0.1 <x < 1.1(see Figure 4.10). Hence the graph of y》 一 P(Gr) 
would appear identical to that of 》 = ln (1 十 x) (see Figure 4.9). 


3. The maximum error on the interval [0, 1] occurs at x 一 0.064724S6 and |errcr| 芯 
0.00002385for0 <x < 1(see Figure 4.10). 
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Figure 4.10 The graph of the error y》 = 无 (x) 一 
ln(1 十 xz) PCxz). 


Rermark. At a node xk we have 了 (xxk) = P(xD .Hence E(xb) 一 0atanode. The graph of 


ECx) = Jrx) 


there is no displacement- 


忆 (xz) looks like a vibrating string, with the nodes being the abscissa where 





INPUT N 
INPUT 4(0), 4(, .4(CN) 
INPUT C 
INPUTX 







人 Algorithm to Evaluate P(xz) 
卫 (N) :==4(N) 
FOR 天 = 入 





1 DOWNTO 0 DO 


已 (及 ) :一 4( 天 ) 十 吾 ( 天 十 1 水 于 


PRINT”*The value P(x) is B(O) 
(ii) Algorithm to Evaluate P'(x) 
DPIN TD):=NrAN) 

FORK =N 1DOWNTIO1DO 


D(KE HH:= 天 *A( 开 ) 十 门 ( 氏 )#* 


PRINT “The value PCx) is D(O) 


(ii Algorithm to Evaluate 7(x) 
7(N+1D):=A4N)/ON +D1 
EOR = N DOWNTO 1 DO 
7(K) :一 4( 民 
7(0) :一 C 十 7(L)* 愉 
PRINT”The value 7(xz) is”, 7(O0) 





1D/ 开 十 7( 玉 十 1* 夸 


{Degree of P(xr)} 
{Coefficients of P(z)} 
{Constant of integrationj 
{Independent variable} 


Space-saving version: 

Poly := 4(N) 

FOR 天 ==N 1DOWNTO0ODO 
Poly := 4( 开 ) 十 Poly# 磋 

PRINT ”The value P(x) 1S”, Poly 


Space-saving Version: 

Denv := 六 +*A4(CN) 

FOR 天 =N_ 1DOWNITO1DO 
Deriv :一 玉 *A( 天 ) 十 Deriv 关 X 

PRINT “The value PCx) is Deriv 

Space-saving version: 

Integ := 4(N)/CN 十 1 

FOR K = N DOWNTIO 1 DO 
Integ := 4(E 1/ 开 十 Integ* 其 

JInteg := C 十 Integx* 其 

PRINIT ”The value 7(x) is Integ 
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辽 xercises for Introduction to Interpolation 





1.，Consider P(xz) = 0.02x3 十 0.1x2 0.2x 十 1.66, which passes through the four 
points (1, 1.$4), (2, 1.5), (3, 1.42), and (3, 0.66). 
(a) Find 已 (4). 
(b) Find P(4)， 
(ec) Find the definite integral of 已 (x) taken over [1, 4]. 
(d) Find the extrapolated value 已 (3.5). 
(e) Show how to find the coefficients of 已 (zx)， 
2，Consider P(x) = 0.04x3 十 0.14x? 0.16x 十 2.08, which passes through the four 
points (0, 2.08), (1, 2.02), (2, 2.00), and (4, 1.12). 
(a) Find P(3). 
(b) Find P(3)， 
人 (c) Find the definite integral of 已 (xz) taken over [0, 3]. 
(dj) Find the extrapolated value 已 (4.5). 
(el) Show how to find the coeffhicients of P(z). 
3. Consider P(xz) = 0.0292166667x3 十 0.275x2 0.570833333x ”1.375，which 
passes through the four points (1, 1.0$), (2, 1.10), (3, 1.3$), and (5, 1.75). 
(a) Show that the ordinates 1.0S, 1.10, 1.3$, and 1.75S differ from those of Exam- 


ple 4.4 by less than 1.8%, yet the coefficients of x3 and x differ by more than 
429%0. 


()， Find P(4) and compare with Example 4.4. 

(CC) Find P'(4) and compare with Example 4.4. 

() Find the definite integral of P(x) taken over [1,4] and compare with Exam- 
ple 4.4. 

(e) Find the extrapolated value 已 (5.$) and compare with Example 4.4. 


Rermark. Part (a) shows that the computation of the coe 针 cients of an interpolating 
polynomial is an il-conditioned problem. 


Algorithms and Programs 


[ee ee | 


1，Write a program in MATILAB that will implement Algorithm 4.1，The program 
should accept the coefficients of the polynomial P(xz) = awxy 二 aN 1XxN 1 十 .十 
cxz2 十 CIX 十 aoasan 1 x Nmatrix: 书 一 [exv QGN 1 .02 08 ao|. 

2. For each of the given functions, the fifth-degree polynomial P(x) passes through 


the Six points (0, 8(0))，(0.2， 太 (0.2))，(0.4, F(0.4))，(0.6,， (0.6))，(0.8， 矿 (0.8))， 
(1 Gd)). The six coefficients of P(x) are ao, al,... ,ds where 


PCx) = a5x5 十 a4x4 十 a3X3 十 a2X2 十 Clx 十 00. 
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GD) Find the coefficients of P(x) by solving the 6 x 6 System of linear equations 
G0 十 GIX 十 aa2x2 十 C3X3 十 C4x4 十 a5x5 = jx 


using xj 一 () 1D/S and 7 = 1,2, 3,4, 3, 6 forthe six unknowns {akjz 0: 

(in Use your MATLAB Program from Problem 1 to compute the interpolated val- 
ues 己 (0.3), P(0.4),， and P(0.5) and compare with (0.3)， 太 (0.4)，and 太 (0.5)， 
respectively. 

(ii) Use your MAILAB program to compnute the extrapolated values P( 0.1) and 
P(1.1 and compare with F( 0.1) and F(1.1), respectively. 

Gv) Use your MAILAB program to find the integral of P(x) taken over [0, 1] 
and compare With the integral of 让 (x) taken over [0, 1]. Plot xz) and P(O) 
over [0, 1] on the same graph.， 

(V) Make a table of values for P(xb)，j(xi, and 民 (z = Fe PPOk)， where 
XU 一 上 /100for 大 = 0, 1 ...，100. 

(a) Jo) 三 上 
(bj Je) =sin0) 
(oj Fa) = 人 十 DCT+D 


3. A portion of an amusement park ride is to be modeled using three polynomials. The 
first section is to be a first-degree polynomial，PIi (x), that covers a horizontal dis- 
tance of 100 feet, starts at a height of 110 feet, and ends at a height of 60 feet. The 
third section is to also be a first-degree polynomial，O1(x), that covers a horizontal 
distance of 50 feet starts at a height of 6S feet, and ends at a height of 70 feet. The 
middle section is to be a polynomial, P(x) (of smallest possible degree), that covers 
ahorizontal distance of 150 feet. 

(a) Find expressions for P(x), 疡 (xx), and OICc) such that P(100) = 瑚 (100)， 
P(100) = 下 (100)，P(250) = 01(0250), and P(250) = @1(250) and the 
curvature of P(x) equals the curvature of Pi(Gxz) atx = 100 and equals the 
curvature of OIGx) atx 三 250. 

(b) 了 Plot the graphs of 户 (x*), PGC),and Cl1(r) on the same coordinate system. 


(e Use Algorithm 4.1(iii to find the average height of the ride overthe given hori- 
Zzontal distance. 


Lagrange Approximation 


Interpolation means to estimate a missing function value by taking a weighted aver- 
age of known function values at neighboring points，Linear interpolation uses a line 
segment that passes through two points，The slope between (x0, y0) and (xl, y1) is 
一 (71 0) xo),andthe point-slope formula fortheliney 一 mxz xo) 十 加 
can be Tearranged as 





(D ?二 00 = 二 (OO1I 2) 


苇 
区 1 


X0 
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When formula (1l) is expanded, the result is a polynomial of degree < 1. Evaluation of 
忆 (x) at xo and xl produces yo and yl, respectively: 


P(xoj 三 MX 十 (1 yo)(0) = 一 y0， 
PGU=+(O yo 人 GD =71. 


The French mathematician Joseph Louis Lagrange used a slightly different method to 
find this polynomial. He noticed that it could be written as 


(2) 


(3) y= Pa) 天 二 2 








XXX1 
十 y1 
X0  X1 X1  X0 


Each term on the right side of (3) involves a linear factor; hence the sum is a polynomial 
of degree < 1. The quotients in (3) are denoted by 

X1 XXX0 
(4) ZL0G) = 一 一 and ZLIG)= 


天 
X0 XI1 X1 MX0” 





Computation reveals that ZL1.0(xo) 三 1 ZL10C01 = 0, ZI100) =0,andZLil0) = 1 
So that the polynomial 疡 (x) in (3) also passes through the two given points: 


(9) 疡 0)=X+yO=X and 户 (xD=y0(0) 十 太一 妨 . 


The terms ZL10(0) and Zi in (4) are called Zapgrazge coefjicierl popymomiiaks 
based on the nodes xo and xl1， Using this notation, (3) can be written in summation 
form 


1 
(9) PCD = 》 ,DIECOD 
k=0 


Suppose that the ordinates yk are computed with the formula 次 = (xb If PC) is 
used to approximate /xzx) over the interval [xo, xl1]，we call the process zterpozctiom. 
I 玉 xzx < Xo(orxzl < 2 thenusing 瑚 (xr) is called extrapolatior，The next example 
ilustrates these concepts， 


了 Example 4.6. Consider the graph 》 = Fr) = cos(x) over [0.0, 1.2]. 
(a) Use the nodes xzo = 0.0 and xl = 1.2 to construct a linear interpolation polyno- 
mijal P (x). 
(b) Use the nodes xo = 0.2 and xl = 1.0 to construct a linear approximating polyno- 
”mial Cl (x). 
Using (3) with the abscissas xz = 0.0 andxl = 1.2 and the ordinates yo = cos(0.0) 一 
1.000000 and 7y1 = cos(1.2) = 0.3623S8 produces 


1.2 xx 0.0 


Pi = 1 一 -十 0. 二 
1CD = 1.0000005 0 一 十 0.362358 二 5 站 


= 0.833333(x 1.2) 十 0.301965(xz “0.0). 
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大 
00 02 04 06 08 10 1.2 0.0 02 04 0.6 08 10 1.2 


(q) (D) 


Figure 4.11  (a) The linear approximation of y = P (xz) where the nodes xo = 0.0 
andxl 一 1.2 are the end points of the interval [a, 四]. (b) The linear approximation of 
yy = C@IGC) where the nodes xo = 一 0.2 andxl = 1.01lie inside the interval [a, 2]. 


When the nodes xzo = 0.2 and xl = 1.0 with yo = cos(0.2) = 0.980067 and yl = 
cos(1.0) 王 0.$40302 are used, the result is 


X 1.0 XY 0.2 
O@l1G) 一 0.28006707 10 十 0.54030210 07 


一 1.225083(x 1.0) 十 0.67S378(x 0.2). 


Figure 4.11(a) and (b) show the graph of 》 = cos(x) and compares it with y = 户 (x) and 
= @Ii(C), respectively. Numerical computations are given in Table 4.6 and reveal that 
CI(CX) has less error at the points xx that Satisfy 0.1 < 共和 1.1. The largest tabulated 
error j (0.6) “ 户 (0.6) = 0.144157,is reducedto F(0.6) CQ1(0.6) = 0.065151 by using 
.CliGc). 四 


The generalization of (6) is the construction of a polynomial PN(x) of degree at 


most N that passes through the N 十 1 points (xo, yo)，(xzl, y1) ,CN,yN) and has 
the form 


和 N 
CO) PC = 》 了 LNk(Cr)， 
. k=0 
where 工 Nk is the Lagrange coe 纤 cient polynomial based on these nodes: 


GCC xX0)GC 大 DG 其 DC xxN) 
8 了 二 -一 一 ， 
人 wk 一 TO 


Itis understood that the terms (x ” 欢 ) and (xk 区) do not appear on the right side of 
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Tabple 4.6 ”Comparison of /(x) = cos(x) and the Linear Approximations Pi(x) and CC 


jxk) 一 cosCxk) Je 户 Cj 





COxp) 














Q@lCi) 




























































。 1.000000 0.000000 1.090008 、 
0.1 0.946863 0.048141 1.035037 0.040033 
0.2 0.893726 0.086340 0.980067 0.000000 
0.3 0.840589 0.114747 0.92S096 0.030240 
0.4 0.787453 0.133608 0.870126 0.050935 
0.5 0.734316 0.143267 0.815159 0.062428 
0.6 0.681179 0.14415S7 0.760184 0.065151 
0.7 0.628042 0.136800 0.705214 0.059628 
0.8 0.574905 0.121802 0.650243 0.046463 
0.9 0.521768 0.099842 0.395273 0.026337 
1.0 0.468631 0.071671 0.340302 0.000000 
1.1 0.415495 0.038102 0.48S332 0.031736 


0.362358 0.000000 0.430361 0.068003 








equation (8). I is appropriate to introduce the product notation for (8), and we write 


六 -0G X 门 
(9) 工 NGCxz) 一 -Ji 
Te 

J7ZK 


Here the notation in (9) indicates that in the numerator the product of the linear 
factors (x 2 世 ) is to be formed, but the factor (X 双 ) is to be left out (or skipped). 
AsSimilar construction occurs in the denominator. 

Astraightforward calculation showsthat, for each fixed K, the Lagrange coefficient 
polynomial 乙 Nkc(x) has the property 


(10) ZN 三 1 when jJ=K and LNkCX 门 =0 when / 头 K. 


Then direct substitution of these values into (7) is used to show that the polynomial 
curvey = PNGxe) goes through (xj ?站 : 


(11) Pi) = y0LNOC 门 十 :十 yjLNJGD 门 十 十 yNELNNGCOD 
= 0(0) 十 … 十 1(D 十 … 十 yN(0) = 


To show that PN(x) i unique，we invoke the fundamental theorem of algebra， 
Which states that a polynomial 7 了 (xz) of degree < N has at most N roots，In other 
words, 让 了 (xz) is zero at N 十 1 distinct abscissas, it is jdentically zero. Suppose that 
Pr) is not unique and that there exists another polynomial CN(x) of degree < NM 
that also passes through the N 十 1 points， Form the difference polynomial 7 了 (zx) 一 
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y= Po) 


(O) 多) 


Figure 4.12 ”(a) The quadratic approximation polynomial y》 一 己 (x) based on the 
nodes xo 一 0.0, xl = 0.6, and xz 一 1.2. (b) The cubic approximation polynomial 
》= 户 (r) based on the nodes xzo = 0.0,xl = 0.4, 2 = 0.8, and x3 一 1.2. 


PC) CNC). Observe that the polynomial T(x) has degree < N andthat T(x 门 一 
Pei CNGeh 站 = 让 世 =0forj =0,1,...,N. Therefore,T(G) 三 0and 站 
follows that CN) = PN()， 

When (7) is expanded, the result is similar to (3). The Lagrange quadratic interpo- 
lating polyriomial through the three points (xzo, y0), (xl, yl1), and (xz, y2) is 


G xlGC 722) (人 X0)C 7) GCC_ _ xo)C xD 
12) 户 ( 人 = 人 人 
0 209 一 加 (xo xxo 7X2) 十 妖 (1 xxX0)GCI 7) (2 xzo)C2 2) 


The Lagrange cubic interpolating polynomial through the four points (xzo, yo), (xl 7)， 
(xz2, 2)， and (xz3， 妆 ) is 


CC 0)G 32) 03) C 2M0)C az)JG 三 ) 

1 履 一 如一 -一 一 一 -一 一 -一 一 一 

09) 户 O) 一 放 RE 0 9 十 7 
人 220) XUGC 2) (人 0) 2 了 2) 
TCR TEST 


了 上 xample 4.7. Consider 》 = fx) = cosG) over [0.0, 1.2]. 


(aj) Use the three nodes xo 一 0.0,xl = 0.6, and x> 一 1.2 to construct a quadratic 
interpolation polynomial 疡 (x). 

(b) Use the four nodes xo = 0.0, xl = 0.4, xz = 0.8, and 2 = 1.2 to constmct a cubic 
interpolation polynomial 忆 (x). 

Using xzo = 0.0,xl 一 0.6, 2x2 = 1.2 and My = cos(0.0) = 1,y = cos(0.6) = 0.825336， 
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and y2 = cos(1.2) = 0.3623S8 in equation (12) Produces 


(人 0.0)(x .2) CC 0.0)(x 1.2) 
0 一 00 0000 1 厅 二 2006 0006 1 


(人 0.0( 0.6) 
+036235815 0007 06 


一 1.388889(X 0.6)(z 1.2) 2.292599(f 0.0)(x 1.2) 
十 0.$03275(G 0.0)(x 0.6). 





Using xo 一 0.0, xl1 =0.4,x2 = 一 0.8,73 一 1.2 and y0 = cos(0.0) 一 1.0, yl1 = cos(0.4) 一 
0.921061, 2 = cos(0.8) = 0.696707, and y3 = cos(1.2) = 0.362358 in equation (13) 
produces 


(人 04) 0.8)( 人 1.2) 
(人 0.0)G 0.8)(C 1.2) 
十 0221061 (04 0.0)(0.4 0.8)(0.4 1.2) 
(人 0.0)X 0.4)( 1.2) 
(0.8 0.0)(0.8 ”0.4)(0.8 1.2) 
(0.0 0.4)G 0.8) 
(12 0.0)(1.2 0.4)(1.2 0.3) 
一 2.604167(C 0.4)(x 0.8)( 1.2) 
十 7.195789(x 0.0)(K 0.8)(x 1.2) 
5.443021(x 0.0)( 人 (0.4)( 1.2) 
十 0.943641(x 0.0)(Cc 0.4)G 0.8). 


Pa(x) 三 1.000000 





十 0.696707 


十 0.362358 


The graphs of y 一 cos(xr) and the polynomials y 一 己 (xz) and y = 户 (xz) are shown in 
Figure 4.12(a) and (bj, respectively. 国 


Error Terms and Error Bounds 


Itis importantto Understand the nature of the errorterm when the Lagrange polynomial 
is used to approximate a continuous function jx). It is similar to the error term for 
the Tayilor polynomial, except that the factor (xz ”xzo)w+l is replaced with the product 
(xx0)( xD) xXN), This is expected because interpolation is exact at each 
of the N 十 1 nodes xf, where wehave FENG) = Jo Po) 一 你 捧 三 0for 
大 一 0, 1 2, ...，N， 


Theorem 4.3 (Lagrange Polynomial Approximation). Assume that F se CN+IL[a, 5b] 
andtihat x0, xl,...,XNE[a,bareN+lnodes.Ixera,Db,then 


414) Jo = PCc) 十 ENGCr)， 
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where Pv (xz) is a polynomial that can be used to approximate 广 (x): 


AN 
(15) Jo s PvGoD = 》 CODENkCD， 


大 一 0 


The error term 无 N(x) has the form 


... (N+Hb 
(16) EC 一 开 0 CN (GO 


(AN TD 
for some value c = c(x) that lies in the interval [c, 户 ]. 


Proof As an example of the general method,， we establish (16) when N = 1. The 


general case is discussed in the exercises. Start by defining the special function g(t) as 
follows 


7 8gO= ADO DO EC 2 2 
(KxX0)(X xxXl) 


Notice that x, xo and xl are constants With respect to the variable f and that 8g(t) eval- 
uates to be zero at these three valuesi that is， 


人 20C 2 
GCC XICE 2) 
(Co xx0)(zo 2) 
Seo 一 Jo Co ED 
Cl xzo)C 加 ) 
(人 xzo)(x xlU 


SC) 三 Jr) PC)  EIC) = jx) DO) EC)=0， 


二 (xzo) 疡 (xo)=0， 


SC) 一 Jr 已 (xl Go) 一 了 (xl) 五 ecD=(0. 


Suppose that x lies in the open interval (xzo, *1). Applying Rolle's theorem to 8g( 力 
on the interval [xo, zx] produces a value do, with xo < do < x, such that 


(18) 8'(ao) = 0. 


A second application of Rolle's theorem to 8(I) on [xz,xi] will produce a value d， 
withxy < dl < xl, Such that 


《19) 8 (di = 0. 
Equations (18) and (19) show that the function 8 (0 is zero at = d0 and : = d. 


Athird use of Rolle's theorem, but this time applied to 8'(1) over [do, di], produces a 
value c for which 


(20) 8g((c) = 0. 
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Now gobackto (17) and compnute the derivatives 8 (1) and 8 (0): 


(人 xxo) 十 4 XUD 


(21) 8 = 三 (人 万 () 200 CC 
HA 一 AI 0 五 . 
(22) 8 (= 三 (0) Im TO CT 


In (22) we have used the fact the PC is a polynomial of degree N 一 1, hence its 
Second derivative is 局 (0) = 0. Evaluation of (22) at the point 上 一 c and using (20) 
yields 
2 

G M0IG TD) 
Solving (23) foer Fi (xz) resujlts in the desired form (16) for the remainder: 
G xz0)C  )FC(c) 

21! ” 
and the proof is complete. .@ 


(23) 0= (oO Er) 


(24) 1(xZ) = 


The next result addresses the Special case when the nodes for the Lagrange poly- 
nomial are equally Spaced xf 三 xX0 十 ip, forK = 0, 1 .….，N, andthe polynomial 
PN(x)is used only for interpolation inside the interval [xo, xN]. 


Theorem 4.4 (Error Bounds for Lagrange Interpolation, Equally Spaced Nodes). 
Assume that F(x) is defined on [a, 5]，which contains equally spaced nodes 太 王 
X0 十 IK. Additionally, assume that (xz) and the derivatives of /oo), up to the order 
N + 1 are continuous and bounded on the Special subintervals [xo, x1], fxo, xz], and 
[xo, *3], respectively; that is， 


(25) IAA+DOJ< MNH for z<xz<xN， 


for N = 1 2, 3. The erorterms (16) corresponding to the cases N = 1 2, and 3 have 
the following useful bounds on their magnitude; 





疡 2AM 

(26) 1E(OoD] < 一 valid for x e [ro xz]， 
. 13M4 

(27) 1E2(o)| < 了 valid for x e fxo xz]， 
j414 

C8) 1BCD1 < 一 了 valid for x e [xz0, 23]， 


Proof ”We establish (26) and leave the others for the reader， Using the change of 
variablesx  x0o 一 fandxy xl 一 1 jitheerrorterm 无 I(x) canbe written as 


( 世 PDFO(Cc) 


C9  O= 书 eo+D= 一 


for 0 < 上 芭 玉 . 
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The bound for the derivative for this case is 
(30) IC(OI< M2 for xz0<c 芭 2 


Now determine a bound forthe expression (12 AD ip the numerator of (29); call 
this term 中 (t) 三 12 ht Since @') = 2f there is one critical point ! 一 有 /2 
that is the solution to d@' (0 = 0. The extreme values of 中 (人 over [0, 户 ] occur either 
at an end point @(0) = 0, 中 (P) 一 Oorat the critical point 中 (P/2) 一 1 /4. Since 
the latter value is the largest, we have estabjished the bound 


| jp2 7 


(31) I@( =|2 Pr < -= for0<1< 


Using (30) and (31) to estimate the magnitude of the product in the numerator in (29) 
resujlts in 


|@(CIFOCcl _ 12M2 


(32 EC 三 末 8 





and formula (26) is established. @ 


Comparison of Accuracy and OAN+D) 


The significance of Theorem 4.4 is to understand a Simple relationship between the 
Size of the error terms for linear quadratic, and cubic interpolation. In each case the 
error bound |N (xz)| depends on 户 in two ways， First, RN+1 is explicitly present so 
that | 有 EN (Cr)| is proportional to jiA+1. Second, the values MN-+1 generally depend on 
六 and tend to | (YX+D(xo)| as 天 goes to zero， Therefore, as 疡 goes to zero, | EN(CGr)| 
converges to zero with the same rapidity that PN+1 converges to zero。The notation 


OA+D is used when discussing this behavior，For example, the error bound (26) 
can be exXpressed as 


LE = OU2 valid for x e [xo,x]]. 


The notation O(p2) stands in Place of 121h2 /8 in relation (26) and is meant to convey 
the idea that the bound for the error term is approximately a multiple of 172; that is， 


IBICODE< C 有 2、 0(00). 
As a consequence, f the derivatives of (xz) are uniformly bounded on the in- 


terval lp < 1, then choosing NM large will make PN+l small, and the higher-degree 
approximating polynomial will have less error. 
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0.2 0.4 0 0.8 


-0.004 


-0.008 





(9) (D) 


Figure 4.43  (a) The eror function 玖 2(xr) = cos(x) 忆 (z)、，(b) The error function 
开 3(x) 一 Cos(x) 书 (x)， 


Example 4.8， Consider y = (xz) = cos(xz) over [0.0, 1.2]. Use formulas (26) through 
(28) and determine the error bounds for the Lagrange polynomials Pi, PP 人 (and P() 
that were constmcted in Examples 4.6 and 4.7， 

First determine the bounds M2, Ma, and M4 for the derivatives | AKCcz)|，|FG)(xz)|， 
and | (xjl, respectively, taken over the interval [0.0, 1.2]: 


IO =| cosCO1 < | cos(0.0)| = 1.000000 = hl， 
|FG)(rj = |sinC00)| < |sin(1.2)| = 0.932039 = 1M43， 
1) = |cos(C)| < cos(0.0)| = 1.000000 = 14. 
For PC(x) the spacing of the nodes is 太一 1.2, and its error bound is 
121M2 _ (1.2)2(1.000000) 


(33) |E1GCo)| < 四 RE 0.180000. 


Eor 户 (x) the spacing of the nodes is = 0.6. and its error bound is 


1313 _ (0.6)3(0.932039) 
9v3 一 9v3 


FEor 户 (xz) the Spacing of the nodes is 瑚 = 0.4, and its error bound is 


(34) 1E2(xz)| < = 0.012915， 


(35) |E3(x)| 


Hi4 .4)4(1.000000 
人 匡 @4 .000000) 一 0.001067. [ 


24 
From Example 4.6 we Saw that |1(0.6)| = | cos(0.6) ” 己 (0.60)| = 三 0.144157, so 
the bound 0.180000 in (33) is reasonable. The graphs of the error functions 无 2 (x) 一 
cos(x) 记 (xr) and E3(x) = cos(x) 疡 (xz) are shown in Figure 4.13(a) and (b)， 
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Table 4.7 “Comparison of /xx) = cos(x) and the Quadratic and Cubic Polynomial 
Approximations 饭 (x) and 户 (r) 














































xb = cosG) ECxh) 
0.0 1.000000 1.000000 0.0 1.000000 0.0 
0.1 0.995004 0.990911 0.004093 0.995835 0.000831 
0.2 0.980067 0.973813 0.00625S3 0.980921 0.000855 
0.3 0.999336 0.948707 0.006629 0.9S$$812 0.000476 
0.4 0.921061 0.915S$92 0.00S469 0.921061 0.0 
0.5 0.877583 0.874468 0.003114 0.877221 0.000361 
0.6 0.823336 0.8253306 0.824847 0.00089 
0.7 0.764842 0.768194 0.764491 0.00035S1 
0.8 0.096707 0.703044 0.696707 0.0 
0.9 0.621610 0.629886 0.622048 0.000438 
1.0 0.$40302 0.$48719 0.541068 0.000765 
1.1 0.4535906 0.4S9542 0.45S4320 0.000724 

0.362358 0.3623S8 0.362358 








respectively, and numerical computations are given in Table 4.7. Using values in the 
table, we find that |2(1.0)| 三 |cos(1.0) 疡 (1.0)| = 0.008416 and |E3(0.2)| = 
|cos(0.2) ”上 声 (0.2)| = 0.000855, which is in reasonable agreement with the bounds 
0.012915 and 0.001607 given in (34) and (3S), respectively. 


MATLAB 


The following program finds the collocation polynomial through a given set of points 
by constructing a Vector whose entries are the coefficients of the Lagrange interpola- 
tory polynomial， The program uses the commands Poly and conv. The poly com- 
mand creates a vector whose entries are the coefficients of a polynomial with specified 
Toots，Ihe conv commands produces a vector whose entries are the coefficients of a 
polynomial that is the product of two other polynomials. 


Example 4.9， Find the product of two first-degree polynomials，P(x) and CCD)，with 
roots 2 and 3, respectively. 
>>P=poly(2) 
了 = 
1 -2 
>>Q=Poly(3) 
Q= 
1 -3 
>>ConV(P,Q) 
ans= 
1 -5 6 


Thus the productof P(xz) and Cr isx2 Sr 十 6. 加 
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Program 4.1 (Lagrange Approximation). To evaluate the Lagrange Po 


P (Cr) 一 六 0 队 ZLNkCxz) based on N 十 1points (xx 交 ) for 大 三 0,1,...,，N. 





function [C,L]=1agran(X,Y) 


%Input -Xis a vector that contains a List of abscissas 
人 -Yis a vector that contains a list of ordinates 
%Output -~ C is a matrix that contains the coefficients of 
儿 the Lagrange :interpolatory PolLynomial 

-Lis a matrix that contains the Lagrange 

名 Coefficient polynomials 

V=length(X) ; 

D=VW-1; 


L=Zzeros (WwW,wW) ; 
khForm the Lagrange coefficient polynonials 
for k=T :n+1 
V=T1; 
tor j=1:n+1 
if X 人 ~ =] 
V=conv(V， polyGX(j)))ACXG) -X(j)) ; 
end 
end 
LGk，,:)=V; 
end 
hkDetermine the coefficients of the Lagrange interpolating 
‰Dolynomial 
C=Yx*L ; 


Exercises for Lagrange Approximation 


1， Find Lagrange polynomials that approximate (xz) 一 x3. 
(a) Find the linear interpolation polynomial PI (x) using the nodes xo = 1and 


X1 一 (0. 
(b) Find the quadratic interpolation polynomial P(x) using the nodes xo 一 1， 
一 0,andx2 = 1. 


(CO Findthe cubic interpolation polynomial 户 (r) usingthenodesxo = 一 1xl1=0， 
X2 一 1,andx3 一 2. 

( 男 Find the linear interpolation polynomial PC(xz) using the nodes xz = 1 and 
X1 一 2. 

(9 Find the quadratic interpolation polynomial 忆 (x) using the nodes X0 = 0， 
Xl 一 1, and x2 一 2. 
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Let Fox) 一 工 十 2/x. 
(a) ”Use quadratic Lagrange interpolation based on the nodes xo = 1, xl 一 2, and 
x2 一 2.Sto approximate F1.$) and 三 (1.2). 


(b) Use cubic Lagrange interpolation based on the nodes xo = 0.5$,xl = 1,x2 一 2， 
and x3 一 2.5 to approximate (1.S) and 矿 (1.2)， 


。Let Fox) 一 2Ssin(rx/6), where x is in radians. 


(a) Use quadratic Lagrange interpolation based on the nodes xo = 0, xl 一 1 and 
X2 一 3to approximate F(2) and 矿 (2.4)， 

(b) Use cubic Lagrange interpolation based on the nodes xo = 0, xl = 1 x2 = 3， 
andx3 一 $ to approximate 广 (2) and 让 (2.4). 

Let xz) = 2sin(rx/6), where xy is in radians. 

(a) Use quadratic Lagrange interpolation based on the nodes xo = 0, xi 三 1l, and 
X2 三 3to approximate 4) and F(3.3)， 

(b) Use cubic Lagrange interpolation based on the nodes xo = 0, xl = 1 x2 = 3， 
andx3 一 Sto approximate 太 (4) and FG3.5). 

Write down the error term 殊 3(x) for cubic Lagrange interpolation to Fox)，where 

interpolation is to be exact at the four nodes xo 一 lxl 一 0,x2 一 3,andx4= 三 4 

and jx)is given by 

(a) Fox) 一 4xr3 3xr 十 2 

(b) xz) 一 xz4 2x3 

(Fo 三 录 5SX4 

Let 让 (x) = 2 

(a) ”Find the quadratic Lagrange polynomial Po(r) using the nodes xo 一 1, xl 一 
1.29, and x2 一 1.5. 

(b) Use the polynomial from part (a) to estimate the average value of / (xz) overthe 
interval {1, 1.5]. 


(@) Use expression (27) of Theorem 4.4 to obtain a bound on the error in approxi- 
mating 太 (x) with 忆 (x). 


。 Consider the Lagrange coefficient polynomials 上 2 kr) that are used for quadratic 


interpolation at the nodes x0，xX1，and xz2， Deftine 8(x) 一 了 上 2.0(x) 十 忆 2,1() 十 
ZL22(x) 1 

(aj) Show that g is a polynomial of degree < 2. 

(b) Show that g(Cxk) 一 0forK = 0, 1,2. ， 

(C) Show that gs) = 0forallx. 三 pL Use the fundamental theorem of algebra. 


Let ZN0G0)， LNICD),.，and ZNNC) be the Lagrange coefficient polynomials 


based on the WN 十 1 nodes xo, xl, .. ,andxN, Show that 0 LN) 一 1forany 
real number 并 . 


Let fx) be a polynomial of degree < N. Let Pv (x) be the Lagrange polynomial of 


degree < N based on the N 十 1 nodes xo, xl ...,XN, Show that Fx) = PNG)for 
all x. Hint Show that the error term 已 N (xz) is identically zero. 
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10. Consider the function Fox) = sin(x) on the interval [0, 1]，Use Theorem 4.4 to 
determine the step size 六 so that 


(3) 
(b) 
(c) 


linear Lagrange interpolation has an accuracy of 10 6 (ie., find 疡 such that 
IE <Sx10 7)， 
quadratic Lagrange interpolation has an accuracy of 10 5 (ie., find Asuch that 
1E2z(Cx)| <Sx10 7 


cubic Lagrange interpolation has an accuracy of 10 6 (ie., find 户 such that 
1E3(Cr)| <Sx 10 7 


11， Start with equation (16) and N = 2, and prove inequality (27). Let xl = xzo 十 必 ， 
X2 一 X0 十 28. Prove that 这 xo <x <x2then 


2 
| 交 xollxz xx 2 < 本 375， 


万 nt Use the Substitutionst 一 X xl 十 户 =X xx0,andf 天 一 X2 and the 
function v(1D) 三 马 如 2 on the interval 大 <f<h.Setu'() =0andsolve forr in 
terms of 严 . 


12. Linearintermpolationiptwodimensions，Consider the polynomialz = P(xr， 7y) = 一 4 十 
ZX 十 Cy that passes through the three points (xzo，y0, z0)，(Cr1， yl1, zl1),， and (x2，y2, Z2). 
Then 4, B, and C are the solution values forthe linear system of equations 


(3) 
(b) 
(9 
(d) 


4 十 Bxo 十 Cy0o 王 z0 
4 二 Bxl 十 Cyl 三 zl 
4 十 有 x2 十 Cy2 一 2Z2. 


Find 4,， 刀 , and C so that > 一 P(x,y) passes through the points (1, 1, 5)， 
(2, 1, 3), and (1, 2, 9). 

Find 4, B, and C so that z = 已 (zx, y) passes through the points (1, 1, 2.5)， 
(2,1,0), and (1,2, 4). 

Find 4，B, and C so that z = PP(x,y) passes through the points (2, 1, $)， 
(1,3, 7), and (3,2, 4). 

Can values 4, 妃 , and C be found so that z 王 P(x, y) passes through the points 
(1 2, 3), (3,2, 7), and (1,2,0)? Why? 


13. Use Theorem 1.7, the Generalized Rolle's Theorem, and the special function 


(人 xo0)( xD xXN) 
sg = OPvO ET 


where Pw (x) is the Lagrange polynomial of degree N, to prove that the error term 
ENC)= xx) Pr)yhasthe form 


JWV+D(c) 


ED 一 CC xx xD xxN) (YY+DL 


瑟 ipt Find gw+DD) and then evaluate itatl 一 c. 
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Aligorithms and Programs 





1，Use Program 4.1 to find the coe 人 cients of the interpolatory polynomials in Prob- 
lem 2(D) a, b, and c in the Algorithms and Programs in Section 4.2. Plot the graphs 
of each function and the associated interpolatory polynomial on the same coordinate 
System， 


2. The measured temperatures during a S$-hour period in a suburb of Los Angeles on 

November 8 are given in the following table， 

(3a) Use Program 4.1 to construct a Lagrange interpolatory polynomial for the data 
in the table. 

(b) Use Algorithm 4.1(iii) to estimate the average temperature during the given 
-hour period. 

(cj) ”Graph the data in the table and the polynomial from part (a) on the same coordi- 
nate System. Discuss the possible error that can result from using the polynomial 
in part (a) to estimate the average temperature. 


Time, PM. | Degrees Fahrenheit 





Newton Polynomials 


I is sometimes Useful to fnd Several approximating polynomials PI(xz)， 疡 (xz)，. ..， 
PCx) and then choose the one that suits our needs，If the Lagrange polynomials 
are used, there is no constructive Telationship between Pv 1(0c) and PNw(z)， Each 
polynomial has to be constructed individually, and the work required to compnute the 
higher-degree polynomials involves many computations. We take a new approach and 
construct Newton polynomials that have the recursive pattern 


(1) ， 瑚 (cr) 一 a0 十 CGI 30)， 
(2) 刀 (xz) 一 0 十 aa X0) 十 az XXX0)G 2)， 
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(3) 户 (xz) 一 ao 十 al 0) 十 aa xzo)GCc  xX1) 
十 4 xzo0)C XUCC 72)， 


(4) PNGC) 一 a0 十 al MX) 十 axX0) 2X1) 
十 43 MO)G XU 22) 
十 4 xxX0)GC XIGCG xx2)CC 23) 十 … 
十 CN  X0) .GO XN 1. 


Here the polynomial PN (x) is obtained from PN 1(0) using the recursive relationship 
(5) PC)=Ph IC) 二 av xx0)GC xD 22) :CC xxXN 1)， 


The polynomial (4) is said to be a Newton polynomial with N_ centers xX0，xX1， 
.YN 1 Itinvolves sums of products of linear factors up to 


CN MX XI 1) YN 1)， 


So _Pv(G) w 鹿 Simply to be an ordinary polynomial of degree < N. 


了 Exampie 4.10. Given the centers zo = 1 2 = 3.x2 = 4andxa = 145andthe 
coefficients ao = $, al = 2,a2 = 0.$,a3 = 0.1, and oa4 三 0.003, find PCx)，P(x)， 
已 (and Pi(xr) andevaluate 应 (2.$) for 有 王 1,2, 3, 4. 
Using formulas (1) through (4), we have 
PC)J)=S 2 1)， 
P0)=5 2 UD+0SCC 1DG 3)， 
户 @= 瑚 m) 01C DC 3)C 和， 
PCI)= 杞 (x) 十 0.003(K UDC 3 4) 4.5)， 
Evaluating the polynomials at x 一 2.$ results in 


Pi(2.3)=3 2(1.5) = 2， 

忆 (2.3) = 已 (2.5) 十 0.5(1.3)( 0.3) = 1.625， 

访 (2.5) = 严 (2.3) ”0.1(1.5)( 0.5)( 1.5) = 1.$125， 

P4(2.3) = 户 (2.5) 十 0.003(1.5)( 0.S)( 1.5)( 2.0) = 1.50575. 国 


Nested Multiplication 


IAAis fxed and the polynomial PNw(x) is evaluated many times, then nested multi- 
plication should be used. The process is similar to nested multiplication for ordinary 
polynomials, except that the centers xXk must be subtracted from the independent vari- 
able x. The nested multiplication form for 户 (x) is 


(0) 户 () = (3 妇 ) 十 02)G 1) 二 al) 20) 十 a0. 
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To evaluate 忆 (x) for a given value of x, start with the innermost grouping and form 
Successively the quantities 


93 一 03， 

2 一 393(X  xX2) 十 02， 
SI 一 S2(X xl1) 十 al， 
0 一 SI  x0) 十 Ga0. 


(7) 


The quantity So is now 户 (x). 


Example 4.11. Compnute 户 (2.5) in Example 4.10 using nested multiplication. 
Using (6), we write 


户 (c)=(( 0.1(x 4) 十 0) 3) 2 1) 十 5. 
The values in (7) are 


4S3 一 “0.1， 

3 一 0.1(2.5 4) 十 0.5 = 0.65， 

4S1 一 0.639(2.3 3) 2= 2.325， 
430 一 2.325(2.3 1) 十 S= 1.$125. 


Therefore, 斑 (2.5) = 1.5125. 四 


Poljynomial Approximation, Nodes, and Centers 


Suppose that we want to find the coefficients ak for all the polynomials 疡 (xz)，...， 
Pw(Gx)that approximatea given function (xz). Then 到 (x) wil bebased on the centers 
X0, xl .Mr and have the nodes xo, xl1，...，Xxk+1。 For the polynomial 户 (x) the 
coefficients ao and al have a familiar meaning. In this case 


(8) 天 wxoj = fo and 疡 (xD = xD. 
Using (1) and (8) to solve for ao, we find that 
(9) J ro) = 忆 (Cxo) 一 ao 十 al1GCo xz0) = ao0. 
Hence ao = F(xo). Next using (1), (8), and (9), we have 
jbD = 三 已 cbD=ao+TaCI xz0) = Jo)+aiCl 20)， 


Which can be solved for al, and we get 


(10) aq 二 ac Jo) 
X1  X0 
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Hence al is the Slope of the secant line pasSing through the two points (x0， 矿 (xo)) 
and (xl1， 太 (xl1)). 

The coefficients ao and al are the same for both 户 (x) and 户 (x). Evaluating (2) 
at the node x2, we find that 


(1H) Jo) = 己 (xz)=Co 二 ac2 xx0) 十 Ga2(x2  X0)(X2 2). 
The values for ao and al in (9) and (10) can be used in (11) to obtain 
_ fa) ao ao2 xzx0) 
(xz2  xo)(xz2 xl) 


-( 吉 Joo) 7G) ye js mo 


X2  X0 1 
For computational purposes we prefer to write this last quantity as 
G2) CD CU Go) 
(12) az = ( 字 一 全 DTeo / oo 
X2  X1 X1  X0 


The two formulas for ca2 can be shown to be equivaient by writing the quotients 
over the comimon denominator (xz2? xl)(x2z xx0)(1 xx0o)，The details are left for 
the reader，The numerator in (12) ls the difference between the first-order divided 
differences. In order to broceed, we need to introduce the idea of dividqed differences. 


Definition 4.1 (Divided Differences)， The divided differences for a function Frx) 
are defined as follows: 


JIxk] = /xb)， 


JE = fx 
XK MXK 1 
13 
(13) Jp = 大 Je2DU 
KMXK 2 
FE = ea 
XE MK 3 


The recursive rule for constructing higher-order divided differences is 


[xx 7j+Db .XIce 六 区 
(14) De 六 三 HE 7 
MXK  XK 7 
and is used to construct the divided differences in Table 4.8. 和 


The coefficients ak of Pxw(x) depend on the values fxzj),for7 = 0, 1 ..., 大 The 
nexttheorem Shows that ak can be computed using divided differences: 


(15) GK 一 了 [xzo, x1，.，.，X1]. 
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Table 4.8 ”Divided-difference Table for y = Ce) 








J[xo, zl] 














7X2 J [xl, xz2] J[xo, xl1,x2] 

X3 J [Ex2, 23] J [xl 22,x3] jJ[xo, xl1, x2, 323] 

X4 J [Exa, xz4] J[x2, xz3,X4] 了 [xl xz2，X3，74 J [ro, xl X2,73，xX4] 
Theorem 4.S (Newton PolynomiaD. Suppose that xo, xl,...,XNareN 二 ldistinct 


numbers in [ca, p]. There exists a unique polynomial Pxv (x) of degree at Inost N with 
the property that 


Geh 门 = 王 PhGi) fory =0,1..，N. 
The Newton form of this polynomial is 
(160) PhGe)=ao+Talx 20) 十 十 NG M0)G 2) xxXN 1)， 


Where ak 王 了 [zxo, xl1, ...，, 妈 ],ftorK 三 0,1,. 


RermarK. If {(xzj,》 门 ] -0 js a set of points whose abscissas are distinct, the values 
Jaxj) = 三 ycanbe used to construct the unique polynomial of degree < N that passes 
through the N 十 1 points. 


Corollary 4.2 (Newton Approximation)， Assume that Pr) is the Newton poly- 
nomial given in Theorem 4.5 and is used to approximate the function 六 (xz), that is， 


(17) Jo = Pr 十 克 V(z)， 


If As CN+lfa, b],then foreachx < fa,bp] there corresponds anumber c = C(xz) in 
(a， 站 ), so that the error term has the form 


(人 MG xD0.G xxN)FN+D(c) 
(V 二 Di 


Remark. The error term 已 N(x) isthe same as the one forLagrange interpolation, which 
was introduced in equation (16) of Section 4.3. 

Lis ofinterest to start with a known fonction 太 (x) thatis apolynomial of degree N 
and compute its divided-difference table、 In this case we know that FVW+Dr) 一 0 
for all x，and calculation will reveal that the (N + lst divided difference is zero. 
This will happen because the divided difference (14) is proportional to a numerical 
approximation for the jth derivative， 


〈18) ZN(x) 一 
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Tabile 4.9 


































First Second Third Fourth Fifth 
divided divided divided divided divided 
difference difference difference difference difference 






Table 4.10 ”Divided-Difference Table Used for Constructing the Newton Polynomials 
应 () in Example 4.13 


Ta 
| 
0.9$64491 


0.5403023 
0.37384537 0.1913017 0.1465592 
0.0879318 


x0 =0.0 






X1 三 1.0 


zi =2.0| ”0.4161468 
















X3 =3.0 0.9899925 


0.6536436 














x4 三 4.0 0.3363499 0.4550973 0.0146568 


Example 4.12， Let Fx) = X3 4x,. Constructthe divided-difference table based on the 
nodes x0 = 1,xl 一 2,...,x5 =0,andfindthe Newton polynomial 忆 (x) based on xo, xl1， 
X2,， 3and X3. 

See Table 4.9. 国 


The coefficients ao = 3, al 三 3,a2 一 0,anda3s 一 1of 户 (xz) appear on the 
diagonal of the divided-difference table. The centers x0 三 1 xl 一 2, andx2 一 3are 
the values in the first column. Using formula (3), we write 


Po) 一 3+3GC HD+6C .Da 2+C DC 2 3). 


Example 4.13。 Construct a divided-difference table for 让 (x) = cos(xz) based on the five 
points (K, cos(K)), forK 三 0, 1 2, 3, 4、Use it to find the coefficients ak and the four 
Newton interpolating polynomials 庆 (x), forK = 1 2, 3, 4. 

For simplicity we round off the values to seven decimal places，which are displayed 
in Table 4.10. The nodes xo, xl1,，X2，xX3 and the diagonal elements da0，a1，a2，63，G4 下 
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Figure 4.14 (al) Graphs of 》 = cos(x) 
and the linear Newton polynomial ” 一 
局 (xz) based on the nodes xzo 一 0.0 and 
X1l 一 31.0. 


FEigure 4.14 (〈b) Graphs of > = cos(z) 
and the quadratic Newton polynomial 
?7 一 户 (x) based on the nodes 20 王 


0.0, xl 一 1.0, and x2 = 2.0. 


Table 4.10 are used in formula (16), and we write down the first four Newton polynomials: 


Pi(x) = 1.0000000 “0.4S96977(x 0.0)， 
妃 (x) = 1.0000000 0.4596977(x 0.0) 0.2483757(x 0.0)(x 1.0)， 
态 (z) = 1.0000000 0.4596977(x 0.0) 0.2483757(K 0.0)C 1.0) 
十 0.1465592(X 0.0)( 1.0)C 2.0)， 
EC) = 一 1.0000000 0.4596977(x 0.0) 0.2483757(x 0.0)(x 1.0) 
十 0.1465592(x 0.0)(x 1.0)(x 2.0) 
0.0146568(x 0.0)G 10)C 2.0)(X 3.0). 
The following sample .calculation shows how to find the coefficient a2， 
.$403023 “10000000 
J[xo, x1] 三 Za 一 Ce03023 1000C0C 一 0.4596977， 
， X1 xxX0 1.0 0.0 
0.4161468 ”0.5403023 
三 El z2] = yE2l 7 = 一 一 一 一 一 一 0.9364491， 
X2  X1 2.0 1.0 
， ， . .4 
局 = po TELDZ] Toa 03956491 十 0.4596977 0.2483757. 
X2 3X0 2.0 0.0 


The graphs of 》 = 三 
Figure 4.14(a), (b), and (cj, respectively. 


CoS(x) andy = 户 (x), > = 户 (x)， andy 一声 (xz) are shown in 


FEor computational purposes the divided differences jn Table 4.8 need to be stored in an 
array Which is chosen to be 刀 (K, ) 门 . Thus (15) becomes 


(19) 


DUKE 旋 三 Jp 六 区 J+1 


,forj < 大 . 
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Figure 4.14 〈c) Graphs of 

y = cos(xz) and the cubic New- 
ton polynomial 》 = 户 (x) based 
on the nodes xo 一 0.0, xl = 1.0， 
2X2 一 2.0, and x3 一 3.0. 





Relation (14) is used to obtain the formula to recursively compute the entries in the array: 


Dj) 1UD) DK 1 1 


(20) DPWw, 记 = 


Notice that the value ak in (1S) is the diagonal element ak 一 刀 (K, 丰 ). The algorithm for 
computing the divided differences and evaluating PN (x) is now given，We remark that 
Problem 2 in Algorithms and Programs investigates how to modify the algorithm so that 
the values {akj are computed using a one-dimensional array. 本 













Program 4.2 (Newton Interpolation Polynomial)。 To construct and evaluate the 
Newton polynomial of degree < N that passes through (xxk, 次) 一 (COxK， 广 (xp)) for 
K 一 0, 1 ...，N: 











2) 






PG) = d0.0 十 由,1Cx 
十 … 十 CNNGX 





X0) 十 才 2 2z0)( 2) 
XO)X xD CC 2XN 1)， 










Where 


不 J 1 友 11 


dk0 王 了 欢 and 不 ) = 
XK MXK 了 





function [C,D]=newpoly(X,Y) 


%Input =- X is a Vector that contains a list of abscissas 
%% -Yis a vector that contains a list of ordinates 
YXoutput - C is a Vector that contains the coefficients 

% of the Newton intepolatory polynomial 

% ~ D is the divided-difference table 


n=1Length(X) ; 
D=zeros (nn) ; 
D(:,1)=Y，; 
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YX Use formula (20) to form the divided-difference tab]e 
for j=2:Dn 一 
for KX=j :D . 
D(Kk,j)=(D(k,j-1)-D(k-1,j-1))V(XCGE)-XCKk-j+t)) 
endQ 
end 


yVDetermine the coefficients of the Newton interpolating 
%pPolynomial 
C=D(n,n) ; 
for k=(n-1) :-13:1 
C=conv(C,poly(X(k))) ; 
m=1length(C) ; 
C(m)=C(m)+D(K,K) ; 
end 


Exercises for Newton Polynomials 





In Exercises l through 4, use the centers x0, X1， 2， andx3 andthe coefficients ao, Cl1,a2,G3， 
and a4 to find the Newton polynomials 户 (xz), 户 (), 户 (x),and 六 (zx), andevaluate them 
at the valuex = c, Bint Use equations (1) through (4) and the techniques of Example 4.9， 


1，ao = 4 al 一 1 ad2=0.4 aa 一 0.01 a4= 三 0.002 


XZ0 一 1 X1 一 3 X2 一 4 X3 一 4.5 C 一 2.5 

2. ao 一 al 一 2 ad 一 0.5 aa 一 0.1 aqa4=0.003 
Xx0 三 0 X1 一 1 X2 一 2 X3 一 3 CC 一 2.5 

3. ao 三 7 al 一 3 4d2 一 0.1 as 一 0.0$  a4 一 0.04 
X0= 1 52X=0 X2 一 1 X3 一 和 Cc 一 3 

4. ao= 2 al=4 0 一 0.04 dd=0.06 qd4=0.005S 
X0== 3 xl 一 | 和 X2=1 X3 一 人 4 C 一 2 

In Exercises $ thorugh 8: 


(a) Compnute the divided-difference table for the tabulated function， 
(b) Write down the Newton polynomials 疡 (xz), 疡 (xz), 用 (xz) and 产 (x)， 
(c) Evaluate the Newton polynomials in Part (b) at the given values of x. 


(dj) Compare the values in part (c) with the actual function value 矿 (x)， 
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S. 


6. oo = 3.6/x 
一 2.5, 3.5 


7.。 8. 


0.01832 





9.Consider the M 十 1points (xXo， y0)，. . (KM，yHMD). 
(a) Ifthe (N 十 1l)stdivided diffterences are zero, then show that the (CN 十 2)nd up 
to the Mth divided diffterences are zero. 


(b) Ifthe (CN 十 Ustdivided differences are zero, then show that there exists a Poly- 
nomiail Px (xz) of degree 入 Such that 


PN 一 次 for 大 三 0 1，...，jM. 


In Exercises 10 through 12, use the result of Exercise 9 to find the polynomial PN (x) that 
goes through the M 十 1 points (N < 1M). 


10. 1. 12. 
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13。Use Corollary 4.2 to find a bound on the maximum error (| 开 2(x)l) on the inter- 
val [0, r], when the Newton interpolatory polynomial 户 (x) is used to approximate 
JJ (x) 一 cos(TYX) at the centers X0 一 0,xl 三 T/2,andx2 一 区 . 


Algorithms and Programs 





1.、Use Program 4.2 and repeat Problem 2 in Programs and Algorithms from Section 4.3. 


2. In Program 4.2 the matrix D is used to store the divided-differencetable. 
(a) Verify that the following modification of Program 4.2 is an equivalent way to 
compute the Newton interpolatory polynomial. 
Tor X=0:N 
ACEK)=Y(kK) ; 
enda 
for j=t:N 
for k=N:-1:j 
有 (K)=((Kk) -ACEK-1) VCX(CK)-XCGK-j)D) ; 
end 
end 


(pb) Repeat Problem 1 using this modification of Program 4.2 


Chebyshev Poiynomials (Optional) 


We now turn our attention to polynomial interpolation for Fr) over [ 1, 1] based 
on the nodes 1<xo<xX<.… <xXN<1 Boththe Lagrange and Newton 
polynomials satisfy 


J xx) = PNG) 十 匹 NOr)， 
Where 


JW+DC) 


(1 五 N(xr) 一 2eOTUT 


and CC) is the polynomial of degree N 十 1: 
(2) @o)=( X0)G 2X1) CC 2XN)， 
Using the relationship 


IEwGCoDl < 1e@GCc)| CT ， 
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Table 4.11 ”Chebyshev Polynomials 


T0(0xc) through 力 (x) 
T0(Cx) 一 1 
71(X) 一 区 


7T(OJ=2xr2 1 

TICx =4x3 3x 

TO=8xr4 8rz+1i 

75(x) = 16x5 20x3 十 Sx 

75(00) = 32x6 48xz4+18x2 1 
7T7(xz) = 64xz7 112x5 +56x3 7Tx 


OU task is to follow Chebyshev's derivation on how to Select the Set of nodes fx 人 0 
that minimizes max 1<x<lflC(x)|}. This leads us to a discussion of Chebyshev poly- 
nomials and some of their Properties. To begin, the first eight Chebyshev polynomials 
are listed in Table 4.11. 


Properties of Chebyshev Polynomials 
Property 1. Recurrence relation 


Chebyshev polynomials can be generated in the following way， Set 70(x) 一 1 and 
71(x) 一 Yandusethe recurrence relation 


(3) Kx) 一 2xT IC) 有 2) for 大 一 2 3，... 


Property 2. Leading Coefficient 
The coefficient of xy in TOJis2w 1when N > 1 


Property 3. Symmetry 
When N =241, 72M(x) is an even function, that is， 


(4) 7T2M( ) 王 7T2M(Cx). 
When N = 2M 二 1 DMICD is an odd fanction, that is， 
(5) ZNHA+IC X) 一 有 2MHA+ICC). 
Property 4. Trigonometric Representation on [ 1 , 


(0) 7TN(x) 一 cos(N arccos(x)) for 1<x<1. 
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Figure 4.15 Graphs of the Cheby- 
Shev polynomials 70G)， TOc)， 
.74(0) over [ 1 工 , 强 ， 





Property $. Distinct Zeros in [ 1 1 
7TN(xz)has N distinct zeros xx that lie in the interval [ 1 1 (see Figure 4.15): 


2 十 1 
(7) cos( 一) for 大 =0, 1 ...，WN 1， 


These values are called the Cjepysjev absczssas (11odes). 


Property 6. Extreme Values 


(8) ITNwGCJl<1 for 1<x<1. 
Property 1 is often used as the dehinition for higher-order Chebyshev polynomials. 
Let us Show that 73(x) 一 2x7D() TiGx). Using the expressions for TiCx) and72(z) 
in Table 4.11, we obtain 
2xmPC) TO 一 2xr(2x2 TD xx=4x3 3x= 了 3()， 


Property 2 is proved by observing that the recurrence relation doubles the leading 
coefticient of 了 ，,(Cx) to getthe leading coefficient of TN (zx). 

Property 3 is established by showing that 2M(xr) involves only even powers of x 
and 72M+i(xz) involves only odd powers of x. The details are left for the reader. 

The proof of property 4 uses the trigonometric identity 


cos(KO) = cos(20) cos((K 2)0) sin(20) Sin((E 2)0)， 
Substitute cos(20) 一 2cos2(6) 1and sin(20) 一 2sin(0) cos(6) and get 


cos(KO) 一 2cos(0)(cos(9) cos( 人 KE 2)0) sin(0)sin((K 2)0)) cos((C 2)0)， 
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which is simplified as 

cos(k) 一 2cos(9) cos((E 1)0) cos((C 2)0). 
FEinally, substitute 9 = arccos(xz) and obtain 


(9) 2xcos(( 1)arccos(x)) cos((C 2) arccos(x)) 


一 Cos(K arccos(x)) for 1<x<1. 
The first two Chebyshev polynomials are 7T0(x) 一 cos(0Oarccos(xz)) = 1 and 


太 (x) = 一 cos(1arccos(x)) 一 X. Now assume that 帮 (x) 一 cos(Karccos(xz)) for 一 2， 
3, ...,N 1. Formnula (3) is used with (9) to establish the general case: 


TnwGD)=2x7TN 10) TN 200 
一 2xcos((N 1)arccos(x)) cos((N 2)arccos(Cxr)) 
一 COS(N arccos(x)) for 1<x<1. 


Properties $ and 6 are consequences of Property 4. 


Minimax 

The Russian mathematician Chebyshev studied how to minimize the upper bound for 
IEN(Gr)l. Oneupperbound can be formed by taking the product of the maximum value 
of 1CG)l over al xn [ 1 1 and the maximum value |F(N+D(OJACON 上 + Di over 


alxzinf 1 1. To minimize the factor maxflC()， Chebyshev discovered that x0， 
X1, ...,XN should be chosen so that O(x) = (1/2N)TN+100). 


Theorem 4.6， Assume that N is fxed. Among all possible choices for O(x) in equa- 
tion (2), and thus among all possible choices for the distinct nodes {zxk] 人 ooin [ 1,1， 
the polynomial T(x) = TNw+iGCD)/2N is the unique choice that has the property 


max ITCO1 < max fl2CoD 中 
Moreovern 

. 1 
(10) ax it Co = 叉 . 


Proof The proof can be found in Reference [29]. @ 
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Table 4.12 ”Lagrange Coefficient Polynomials Used to Form 疡 (zx) 
Based on Equally Spaced Nodes 尼 三 1 工 +2K13 


ZL3 0(r) = 0.06250000 上 0.06250000x 上 0.56250000x2 ”0.56250000x3 
ZL3.1(x) 一 ”0.56250000 ”1.68750000x 0.56250000x2 十 1.68750000x3 
3.2(z]) 一 0.56250000 + 1.68750000x ”0.56250000x2 ”1.68750000x3 
ZL.3 30 一 0.06250000 ”0.06250000x 十 0.56250000x2 十 0.56250000x3 





The consequence of this resujlt can be stated by saying that, for Lagrange interpo- 
lation 太 x) 三 PyGC) 十 忆 NG) onf 1 1,the minimum vaiue of the errorbound 


(maxflCCc)I)(maxflyw+DGoOACN DID 


is achieved when the nodes {2] are the Chebyshev abscissas of 7Txv+1GC). As an L- 
lustration，we look at the Lagrange coefficient polynomials that are used in forming 
斑 (x). First we use equally spaced nodes and then the Chebyshev nodes. Recall that 
the Lagrange polynomial of degree N = 3 has the form 


(1 声 (x) = Jrxo)L30(x) 十 JUDL3,1GCD) 十 Fa2)Z32(0x) 十 耻 (x3)3.3(x)， 


了 quajly Spaced Nodes 
开 fc) is approximated by a polynomial of degree at most N = 3 on [ 1, 1], the 
equally spaced nodes x0 = 1 xl 三 3,z22 = 1/3, and xz = 直 are easy to 


use for calculations. Substitution of these values into formula (8) of Section 4.3 and 
simplifying will produce the coefficient polynomials 上 .3 kz) in Table 4.12. 


Chebyshev Nodes 


When F(x) is to be approximated by a polynomial of degree at most N = 3, using 
the Chebyshev nodes x0 三 cos(TTT/8), xl 一 cos(Sr/8), 2 三 cos(3T/8), and xz3 王 
cos(r/8)，the coefficient polynomials are tedious to find (but this can be done by a 
computer). The Tesults after simplification are shown in Table 4.13， 


Exarmple 4.14. Compare the Lagrange polynomials of degree N 一 3 for F(x) = ex that 
are obtained by using the coefficient polynomials in Tables 4.12 and 4.13, respectively. 
Using equally spaced nodes, we get the polynomial 


P(x) = 0.99519577 十 0.99904923x 二 0.54788486x2 十 0.17615196x3. 
This is obtained by finding the function values 


Joo) = e( 0 = 0.36787944， ”oa) = e( LU3) = 0.71653131， 
fa) = ed = 1.39561243， 03) = e(0) = 2.71828183， 
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Table 4.13 “Coefficient Polynomials Used to Form 户 (x) Based on the 
Chebyshev Nodes 砍 = cos((7 2K)T/8) 


CoCr) = ”0.10355339 + 0.11208538x 十 0.70710678x2 ”0.76536686x3 
Cl1(r) = 0.60355339 ”1.57716102x ”0.70710678x2 十 1.84775906x3 
C2(x) = ”0.60355339 + 1.57716102x ”0.70710678x2 1.84775906x3 
C3(r) = 0.10355339 ”0.11208538x 十 0.70710678x2 十 0.76536686x3 


and using the coefficient polynomials ZL3k(x) in Table 4.12, and forming the linear combi- 
nation 


P(x) = 0.3678794473.0(x) 十 0.716531317.3,1(x) 十 1.39561243732(x) 
十 2.718281837.3.3(x). 


Similarly, when the Chebyshev nodes are used, we obtain 
VC = 0.99461532 十 0.99893323x 十 0.34290072x? 十 0.17S17569x3. 


Notice that the coefficients are different from those of P(xz). This is a consequence of using 
diffterent nodes and function values: 


Co) = e 092387953 二 0.39697597， 
JGxl) = e 038268343 一 0.68202877， 
J Coz) = e038268343 一 1.46621380， 
J (03) = e0322387953 -= 2.51904417. 


Then the altermnative set of coeffcient polynomials Ck (x) in Table 4.13 is used to form the 
linear combination 


VY(Gz)= 0.39697597Co(x) 十 0.68202877C1(x) 十 1.46621380C2(x) 十 2.51904417C3(x). 
For a comparison of the accuracy of P(x) and V(xz), the error functions are graphed 
in Figure 4.16(a) and (b), respectively，、The maximum error |ez ”已 (xz)| occurs at x 一 
0.7$490129, and 
le Pr)|l < 0.00998481 for 1<x<1. 
The maximum error |e< VCG)|occurs atx 一 1,and we get 


lez  YCD)l < 0.00665687 for 1<xz<1. 


Notice that the maximum error in Y(z) is about two-thirds the maximum error in 已 (x). 
Also, the error is Spread out more evenly over the interval, 国 
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(9) 世 ) 


Figure 4.106  (a) The error function y 一 e< PP(x)forLagrange approximation over[ 1, 1]. 
(b) The error function 》 = ex ”YY(Gx) for Lagrange approximation over [ 1, 1]. 


了 unge Phenomenon 


We now look deeper to see the advantage of using the Chebyshev interpolation nodes. 
Consider Lagrange interpolating to jj(x) over the interval [ 1, 1] based on equally 
Spaced nodes. Does the error EN = jx) PN)tendto zeroas N increases? For 
functions like sin(x) or er, where all the derivatives are bounded by the Same constant 
M,the answer is yes. In general, the answer to this question is no, and it is easy to find 
functions for which the sequence { PN (x)} does not converge. If fox) = 17(1 十 12x2)， 
the maximum of the error term EN() grows when N 一 co. This nonconvergence 
is called the Rumrge Pjeromzemnom (See Reference [90], pp. 275-278). The Lagrange 
polynomial of degree 10 based on 11 equally spaced nodes for this function is shown 
in Figure 4.17(a). Wild oscillations occur near the end of the interval. If the number of 
nodes is increased, then the oscillations become larger. This problem occufrs because 
the nodes are equally spaced! 

I the Chebyshev nodes are used to construct an interpolating polynomial of de- 
gree 10to Foxz) = 17/(1+ 12x2), the erroris much smaller as seen in Figure 14.17(Cb)， 
Under the condition that Chebyshev nodes be used, the error 匹 N(r) will go to zero 
as N 一 co. mn general, 让 Fox) and F(x) are continuous on [ 1, 1], then it can be 
proved that Chebysherv interpolation will produce a sequence of polynomials { Pw(x)} 
that converges uniformly to F(x) over [ 1 划 . 


Transforming the Interval 


Sometimes it js necessary to take a problem stated on an interval [ca, j] and reformu- 
late the problem on the interval [c, d] where the solution is known, If the approxima- 
tion Pw(x) to jx) is to be obtained on the interval [wa, j], then we change the variable 
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Figure 4.17  (a) Tbe polynomial 
approximation to y》 = 1/(1 十 12x2) 
based on 11 equally Spaced nodes 
over [ 1, 吉 . 





Figure 4.17 〈b) The polynomial 
approximation to y = 1/(1 十 12x2) 
based on 11 Chebyshev nodes over 
[ 1 ]， 





So that the problem is reformulated on [ 1, 1]: 


- PP 4 Q 十 已 X CQ 
(12) z=( 了 镍 + OT 1 一 2 1， 








whberea<xXx<pand 1<!<1. 
The required Chebysheyv nodes of TH+HiG) on[ 1 1] are 


区 
一 2 ] 一 -一 一 一 0，1，...， 
(13) 杂 三 COS ( 人 十 2 本 5 for 一 0,， 1 


and the interpolating nodes on fa, P] are obtained by using (12): 


DP 4 4+pB 
十 


14 一 
(14) 区 二 帮 一 7 7 








for 大 一 0， 1，. ..，N. 
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Theorem 4.7 (Lagrange-Chebyshev Approximation Polynomial). Assume that 
Pr) is the Lagrange polynomial that is based on the Chebyshev nodes given in (14). 
fsCw+lfa,b,then 


09) fo PwGol< 2 全 max fl7+DCo 
人 ”TION 十 Diosxsb 
Example 4.1S. For jx) = sin(xz) on [0,r/4], find the Chebyshev nodes and the error 
bound (1$) for the Lagrange polynomial 疡 (x). 
Formulas (12) and (13) are used to find the nodes; 


1 
eos( 定 和 ) 生 + for 大 一 0，1，...，5. 
Using the bound jjG@O(CD)| <| sin(r/4)|=2 ?2 = Min(15), we get 
ZNY6f 2 17 
IFoD) PCoOl< (5) ( 动 ) < 0.00000720， 
Orthogonal Property 


了 Example 4.14, the Chebyshev nodes were used to find the Lagrange interpolating 
polynomial. In general, this implies that the Chebyshev polynomial of degree N can be 
obtained by Lagrange interpolation based on the N 十 1 nodes that are the N 十 1 zeros 
of Tw+t(Cxz)，However a direct approach to finding the approximation polynomial is 
to express PN(x) as a linear combination of the polynomials 7 (x), which were given 
in Table 4.11 Therefore, the Chebyshev interpolating polynomial can be written in the 
form 


AN 
〈106) PNGc) 一 》 ckTkCx) 三 C070(0) 十 cmGCc) 十.… 十 CNTN(Gc). 
天 一 0 


The coefficients {ckj in (16) are easy to find. The technical proof requires the use 
of the following orthogonality properties. Let 


2K 十 1 
一 一 一 一 一 。。。 ; 
(17) JXK 一 COS (= 区 for K 王 0，1， ，ANV; 
N 
(18) 2>_TCDTGCD =0 when i 关 让 
类 一 0 
心 N+1l1 ， 
(9) 2_TGDTCb = 一 wheni=7 关 0 
炎 一 0 
AN 
(20) 2_ TCDTooe = N 二 1 
K=0 


Property 4 and the identities (18) and (20) can be used to prove the following 
theorem 


一 一 qq、evirveeeeesaeairrmnrrern 一 一 
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Theorem 4.8 (Chebyshev Approximation)。. The Chebyshev approximation polyno- 
mial Pw(x) of degree < N for jz) over[ 1 1] can be written as a sum of {77(c): 


AN 
CD Fo s PvGooD = >》 cjT00. 
J 一 1 
The coefficients {cj] are computed with the formulas 
1 
(22) co== - 过 Jcomeo = 万 NTZ7Teo 
and 
cj = 六 HT 二 yeor Ce 
Jr 十 1 站 
(23) ”= 二 yeom (2 ) for / = 1 2，...，N. 


Exampie 4.16. Find the Chebyshev polynomial 户 (x) that approximates the function 
Ja) 王 exrover[ 1,1]. 

The coef 人 cients are calculated using formulas (22) and (23)，and the nodes X 一 
cos(T(2K 十 1)/8) for 大 一 0, 1,2, 3. 


-1 etT(xb = 1 人 ex 一 1.26606568， 
4 铝 


世 一 一 世 -一 
c1 一 二 kz) 一 5 1 y。 xx 一 1.13031500， 





1 1 2K+1 
c = 艺 乞 Po = 了 艺 二 cos (= 8 ) = 0.27145036， 


一 二 1 e 汪 及 (xi) 一 了 COS (= 二 


“2 各 





) 一 0.04379392， 


Therefore, the Chebyshev polynomial 声 (x) for ex is 


(24) 户 (x) 一 1.2660656870(x) 十 1.1303150071(0c) 
十 0.2714503672(r) 十 0.0437939273(x)， 


Ithe Chebyshev polynomial (24) is expanded in powers of x, the result is 
户 (x) = 0.99461532 二 0.99893324x 十 0.S4290072x2 十 0.17517568x3， 


which is the same as the polynomial V(x) in Example 4.14. If the goal is to find the 
Chebyshev polynomial, formulas (22) and (23) are preferred. [ 
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MATILAB 


The following program uses the eval command instead of the feval comimand used 
in earlier programs. The eval command interprets a MATLAB text string as an ex- 
Pression or statement，For example, the vB commands will quickly evaluate 
cosine at the values x 一 K/10 fork 上 = 0, 1,...,5: 


>> X=0: .1:.5; 
>> eVal(:cos(x):) 
ans = 


1.0000 0.9950 0.9801 0.9553 0.9211 0.8776 


Program 4.3〈Chebyshev Approximation). To construct and evaluate the Cheby- 
shev interpolating polynomial of degree N over the interval [ 1, 1], where 


六 
P(OD) = 》 cj7TT(CD 
=0 


is based on the nodes 
cg (2K 十 1 
由 2 上 +2 
function [C,X,Y]=cheby(fun,n,a,b) 





%Input - fun is the string function to be apProximated 
包 -~ N is the degree of the Chebyshev interpolating 
和 Polynomial 

攻 -~ a is the left end point 


b is the Tight endq Point 

%Dutput - C is the coefficient 1ist for the Polynomial 
久 - X containg the abscissas 
和 - Y contains the ordinates 
if Dnargin==2，a=-1ib=liend 
d=PIi/(2*n+2) ; 
C=Zzerogs (1 ,n+1) ; 
for K=1:D+1 

X(k)=cos((2*+*k-1)*+d) ; 
end 
X= (b-a)*+X/V2+(atb)/2; 
X= 色 ; 
Y=eval (fun) ; 
for Kk =1:n+1 

Z= (2*k-1)#d; 

for j=1:n+i 
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C(j)=C(Cj)+Y(K)*cos((j-1)*z) ; 
enaQ 
enda 
C=2*C/ (n+1) ; 
CC1)=C(1)V2; 


Exercises for Chebyshev Polynomials (OpbtionaD 


1 Use property 1 and 
(a) “construct 下 (xz) from 73(xz) and (x). 
(b) construct 75(Cx) from 74(x) and 73(x)， 


2.，Use property 1 and 
(a) construct 76(x) from 75(x) and 7T4(x)， 
(b) construct 77(x) from 76(x) and 75(x). 


3， Use mathematical induction to prove property 2. 
4. Use mathematical induction to prove property 3， 
S. Find the maximum and minimum values of 7 (x). 


6.Find the maximum and minimum values of 73(x). 
瑟 nt 23(1/2) =0and 7 (172) = 0. 
7. Find the maximum and minimum vatues of 74(x)， 
Bint TOD=0TC LI9=0and7f( 2 1 = 0. 
8， Let fx) = sin(x) on[ 1, 1]. 
(a) Use the coeftcient polynomials in Table 4.13 to obtain the Lagrange-Chebyshev 
polynomial approximation P3(x). 
(b) Find the errorboundfor |sin(xc) 声 (r)|. 
9. Let ex) =ln(x 二 2) on[ 1,11. 


(a) “Use the coeffhicient polynomials in Table 4.13 to obtain the Lagrange-Chebyshev 
bolynomial approximation P(x). 


(b) Find the error boundfor |ljn(x 十 2) 户 (x)|， 
10. The Lagrange polynomial of degree N = 2 has the form 


JG) = Faxo)Z2.00) 十 GCTDZL210x) 十 了 (xc2)22(x). 


Hthe Chebyshev nodes xo = cos(Sr/6), xl = 0, and z2 一 cos(T/6) are used, show 
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that the coefficient polynomials are 


DC = 苇 2 
2,0(X) 一 \V 了 3 3 ， 
4x2 
Z2,1(X) 一 1 本 
Po = 世上 和 
22 一 人 本 


11，Let (xz) = cos(x) on[ 1 1]. 
(a) Use the coefficient polynomials in Exercise 10 to get the Lagrange-Chebyshev 
polynomial approximation 忆 (x)， 
(b) Find the error bound for |cos(Cx) 殊 (x)|， 
12. Let 太 x) 一 ez on[ 1 1]. 


(a) ”Use the coefcient polynomials in Exercise 10 to get the Lagrange-Chebyshev 
polynomial approximation 忆 (x). 
(b) Find the error bound for lex 己 (x)|. 


In Exercises 13 through 15, compare the Taylor polynomial and the Lagrange-Chebyshev 
approximates to j(xz) on [ 1, 1]. Find their error bounds. 


13.、jJ Cox) = sin(xz) and N = 7; the Lagrange-Chebyshev polynomial is 
sin(x) As 0.99999998x ”0.16666599x? + 0.00832995x5 0.00019297x7. 
14，j(x) = cos(z) and N = 6; the Lagrange-Chebyshev polynomial is 
cos(x) 久 1 0.49999734x?2 十 0.0416453Sx4 0.00134608x6. 
1S. Ja) 一 eandN =7;the Lagrange-Chebyshevpolynomial is 
ex 入 0.99999980 十 0.99999998x 十 0.50000634x? 
十 0.16666737x5 十 0.04163504x4 十 0.00832984x5 
十 0.00143925x6 十 0.00020399x7. 


16。Prove equation (18). 
17。Prove equation (19). 


Algorithms and Programs 


[er | 
In Problems 1 through 6, use Program 4.3 to compute the coefficients {ckj for the Cheby- 
Shev polynomial approximation PN(x) to fc) over[ 1 1,when(a) N 一 4,(bN=5， 
(ON =60and(dN =7. Ineachcase,plot For) and PN on the Same coordinate 
System. 


，jG) = ex 2.j(x) 一 Sin(x) 
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3。j 丰 (xz) = cos(X) 4. jx) 一 In(x 十 2) 
S。 jx) = 十 2)17? 6 Co) = (十 2)C+2) 
7.。Use Program 4.3 (N = 5$) to obtain an approximation for 用 cos(x2) dx， 


Padt Approximations 


In this section we introduce the notion of rational approximations for functions. The 
function jx) will be approximated over a small portion of its domain. For example， 
让 fx) = cos(x),it is sufticient to have a formnula to generate approximations on the 
interval [0, /2]. Then trigonometric identities can be used to compute cos(x) for any 
valuex that lies outside [0, 立 /2]. 

A rational approximation to (xz) on [fa, pb is the quotient of two polynomials 
PN()and CNMN(C) ofdegrees NW and Mrespectively. We use the notation RN AMNCz) to 
denote this quotient: 


PNOr) 
CNMN) 


Our goal is to make the maximum error as Small as possible. For a given amount 
of computational effort, one can usually construct a rational approximation that has a 
smaller overall error on [4a, p] than a polynomial approximation. Our development is 
an introduction and will be limited to Pade approximations. 

The metjod of Padi requires that F(x) and its derivative be continuous atx = 0. 
There are two reasons for the arbitrary choice of x = 0. First, it makes the manipula- 
tions Simpler. Second, a change of variable can be used to shift the calculations over to 
an interval that contains zero. The polynomials used in (1) are 


(IUD) RN NG) 三 for a <y< 了 


(2) PwG)= po 十 Piz 十 po 好 十 十 PNXN 
and 
(3) Ow(z)=1+g7 十 g2z 十 十 gMX. 


The polynomials in (2) and (3) are constructed so that Fr) and RN NGCr) agree at 
X 一 0andtheir derivatives upto N 十 Magreeatx 一 0. inthecase Co(0x) = 1the 
approximation is just the Maclaurin expansion for F(x). For a fxed value of N 十 M 
the error is smallest when Pvw(x) and COM() have the same degree or when PN(z)has 
degree one higher than CNM (xz)， 

Notice that the constant coefficient of CM is go = 1. This is permissible, because 
it cannot be 0 and RN,MNM(x) is not changed when both PN(Gr) and CNMO) are divided 
by the same constant, Hence the rational function RN NO has N 十 M +1Lunknown 
coefficients. Assume that (xz) is analytic and has the Maclaurin expansion 


(4) Fo0 一 am 十 0 十 0 大 十 十 G 人 十， 
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and form the difference Foxz)CMNC) PNx) 一 QZ0x): 


0 。 4 . _ oo _ 
(9) (| (| 》 PPjX7 一 >》， cj2x1. 
7=0 姜 0 70 jN+M+1 


The jower index / = MT+ANT 二 linthe summation on the right Side of (9) js chosen 
because the first N 十 M derivatives of F (xx) and RNMN(Cc) areto agreeatx 一 0. 

When the left side of ($) is mnultiplied out and the coefficients of the powers of x7 
are Set equal to zero forK = 0, 1 ...,N+AM,theresultisasystemnofN 二 MT+1 
linear equations: 


40 po=0 
d100 十 Q1 PPI = 
(0) d240 十 dlIai 十 az 有 =0 


94340 十 92al 十 9142 十 3 p3 一 0 
GMQN M 十 4M LN M+LI 十 … 十 QN PN 一 0 
and 
GMQN M+I 十 MUM 10N MA+2 十.… 十 gl1QN 十 aN+1 =0 


GMGIN M+2 十 MUM 14N M+3 十 … 十 9IQN+L 十 QN+2 三 0 
(7) 


GMGN 十 gM 1lCN+1 十 … 十 9qIQN+M 1 十 QN+MH 三 0. 


Notice that in each equation the sum of the Subscripts on the factors of each product 
is the same, and this sum increases consecutively from 0to N 十 M. The M equations 
in (7) involve only the unknowns 91, 92, ...,9M and must be solved first， Then the 

equations in (6) are used Successively to find po, pl1, . . .，PN. 


Example 4.17. Establish the Pade approximation 


15,120 ”6900x2 十 313x4 
1 co 4 一 15120 十 650x5 二 374 
See Figure 4.18 for the graphs of cos(x) and R4.4(x) over [ 5, 35]. 
Ithe Maclaurin expansion for cos(x) is used, we w 记 obtain nine equations in nine 
Unknowns，Instead, notice that both cos(x) and R44(xz) are even functions and involve 
powers of x2. We can simplify the computations 诺 we start with 让 (x) = cos(z1/2): 


1 
全 /00 一 1 了 + 元 二 3207 


In this case, equation (5) becomes 


1 2 1 3 1 4 2 2 
1 一 一 一 一 - 。。。 1 十 X 十 G2XX 六 P1X 2X 
( X 十 万 X ”十 。 大 ( 7 22 ) 0 1 尼 


=0 二 0r+0xz 十 0r3 十 0xr4 二 csx5 十 c6x5 十 .… . 
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了 二 





Figure 4.18 The graph of y = cos(x) and its Padk 
approximation R4 4(x). 


When the coe 人 fcients of the first five powers of x are compared，we get the following 
System of linear equations: 


1 Po=0 


1 
二 一 0 
了 十 41 P1 

(10) 1 0 十 -0 

革 7291 22 “P2 三 
1 1 1 1 

720 一 了 和 22 一 

1 


1 1 0 
4 和 .320 72024 一 歼 儿 一 


The last two equations in (10) must be solved first_ They can be Tewritten in a form that is 


easy to Solve: 


1 1 
dl 1242 = 30 and 41 十 3092 三 3556: 


First find q2 by adding the equations; then find Ga1 


171 1 13 
0 和 一 请 ( 志 亏 ) 五 120， 
1 ， 16 11 


和 二 有 十 1120= 257 


Now the first three equations of (10) are used. It is obvious that po 三 1, and we can 
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use gl and g2 in (11) to solve for pl and P2; 


可 1 315 
(1 站 2 5 0255， 
1 311 13 313 





P 一 世 54+15100=1 生 150 


Now use the coefficients in (11) and (12) to form the rational approximation to 太 (x): 


1 11S$x/252 十 313x2/115,120 


1 穴 一 De IC DT 
(13) J Cr) 1 上 + 11x/2$2 二 13x2/1$,120 


Since cos(x) 一 了 (xz2)， we can substitute x2 for x in equation (13) and the resujlt is the 
formujla for R4 4(xz) in (8). 国 


Continued Fraction Form 


The Padk6 approximation R4 4(xz) in Example 4.17 requires a minimum of 12 arithmetic 
operations to perform an evaluation. It js possible to reduce this number to seven by 
the use of continued fractions. This is accomplished by starting with (8) and finding 
the quotient and its polynomial remainder. 


1$,120/313 (6900/313)xz2 十 x4 
15,120/13 十 (660/113)x2 十 X4 
313 (2 人 12,600/823 十 X2 ) 


R4.4(x) 一 


”13 AN 169 15,120/13 十 (600113)x2 十 X4 


The process is carried out once more using the term in the previous remainder， The 
Fesult is 


R Oo 313 296,280/1169 
13 15,120/113 十 (660/13)x2 十 x4 
12,600/823 十 x2 
313 296,280/1169 
”13 379380 ，420,078,960/677,329 





10.699 12.6001823 十 z 
The fractions are converted to decimal form for computational purposes and we obtain 
《14) Ra44() = 24.07692308 


1753.13609467 
35.45938873 十 xz 十 620.19928277/1(15.30984204 十 x2)” 
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一 1.0 -0.5 0.0 0.5S 1.0 0.000025 
0.000020 
0.000015 
0.000010 


0.000005S 





-1.0 -0.$ 0.0 0.5 1.0 


(a) (D) 
KEigure 4.19 (a) Graph of the error 匹 R(Z) 一 cos(x)  R44() forthe Pad6 approxima- 


tion R4.4(x). (b) Graph ofthe error 已 pP(x) 一 cos(O) 上 (xc)forthe Taylorapproximation 
6540). 


To evaluate (14), first compute and store x?z, then proceed from the bottom right term 
in the denominator and tally the operations: addition, division, addition, addition, divi- 
sion, and Subtraction. Hence it takes a total of seven arithmetic operations to evaluate 
R4.4(x) in continued fraction form in (14). 

We can compare R44(x) with the Taylor polynomial 疡 (x) of degree N = 6， 
which requires seven arithmetic operations to evaluate when it is written in the nested 
form 


_ 2f 工 :( 专 南 呈 )) 
(15) moO=1+2( 本 十 莽 7207 


= 1+x2( 0.5 上 十 x2(0.0416666667 ”0.0013888889x 轨 )， 


The graphs of ER(x) = cos()  R44() and 尼 p(xr) 一 cos(x) 六 (xr)over[ 1 9 
are Shown im. 责 gure 4.19(a) and (b)，respectively， The largest errors occur at the 
end points and are ER(1) 一 ”0.0000003599 and 五 P(1) = 0.0000245281, respec- 
tively，The magnitude of the largest error for R4 4(z) is about 1.4679 of the error 
for 疡 (x). The Pade approximation outperforms the Taylor approximation better on 
smalier intervals, and over [ 0.1,0.1] we find that ER(0.1) 一 0.0000000004 and 
P(0.1) 一 0.0000000966, so the magnitude of the error for R44(x) is about 0.3849%2 
of the magnitude of the error for 应 (zx)， 
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Exercises for Pade Approximations 





1。Establish the Pade approximation: 


2. (3) 


(D) 


3. (3) 


(b) 


4.(a) 


(b) 


() 
5S。(a) 


(b) 


2 
ex 必 Ril1Cc) 一 十 工 
2 XXX 





Find the Padk approximation RII(C) for xz) = ln(1 十 xz)/x. BinL Start with 
the Maclaurin expansion: 


2 
关 区 
=1 二 上 + 二 
J Co) 本 十 本 
Use the result in part (a) to establish the approximation 


6x 十 X2 


ljn(1 十 xz) 多 Rao1() 一 3 


Find Ri IC) for fox) = tan(CxLl 人 /xl2 Ent Start with the Maclaurin expan- 
Sion: 


X 2x2 
二 1 二 二 上 + 二 
(xz) 十 可 十 15 


Use the result in part (a) to establish the approximation 


十 …， 


1Sx  X3 


tan(x) 六 玉 = 一 -一 一 . 
GO 穴 Ra200) 一 15 


Find RI1(C) for jxz) = arctan(xL2AxL2 ipt Start with the Maclaurin 
expansion: 


2 
关 攻 
=1 二 二 一 
Jr) 本 十 七 
Use the result in part (a) to establish the approximation 


1S$x 十 4x3 


arctan(x) 入 Ra2() 一 十 977 


Express the rational function R3,2(x) in part (b) in continued fraction form， 
Establish the Padk approximation: 


12 十 6x 十 x2 


攻 A 久 民 一 一 一 
“ 22(x) 12 6x 十 X2 


Express the rational fanction R2 2(x) in part (a) in continued fraction form. 


SEC. 4.6 


6. (a 


(D) 


() 
7.(a) 


(D) 


《c) 
8.、(3) 


() 


(c) 
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Find the Padk approximation R2 2(x) for 太 (x) = jn(l 十 x) 人 .TDnt Start with 
the Maclaurin expansion: ， 


克 


X2 区 
3 5 


Ja-=1 5+ 本 


2 和 


Use the result in part (a) to establish 


30x 十 21x2 十 X3 


ln + 有 0 一 一 
n+ 划 全 局 200) 一 0 十 3 三 十 9 


Express the rational function Ra 2(x) in part (b) in continued fraction form. 
Find R2 2(xz) for F(x) = tan(xzL2) /xlI2， Bint Start with the Maclaurin expan- 
Sion: 


ja =1+Z+2 TD Ge 
加 3 1 3153 2835 ， 


Use the result in part (a) to establish 


94Sx “10S$x3 十 X5 


ft 久 民 一 一 一 一 一 一 一 一 -一 一 一- 
an00 5400 一 9500 十 15 


Express the rational function Rs 4(xz) in part (b) in continued fraction form. 


Find R2 2(z) for Foxz) = arctan(xl/ /xl2，Hint Start with the Maclaurin 
expbansion: 


he 
Lo 


半 六 


本 本 十 


| 水 


基 
二 [1 -一 
J GD) 了 十 
Use the result in part (a) to establish 


94Sx 十 73Sx3 十 64x5 


arctan(r) 六 RR54(r) 一 945 十 1050x2 二 2757 


Express the rational functionRs,4(x) in part (b) in continued fraction form， 


9. Establish the Padk approximation: 


120 十 60xz 十 12x2 十 X3 


Y 入 及 一 -一 一 一 一 一 一 一 一 一 一 一 一 
4 Ra00 一 0 6 二 15 十 站 


10. Establish the Pad6 approximation: 


1680 十 840x 十 180x2 十 20x3 十 X4 


X 及 一 一 -一 一 一 一 一 一 一 一 一 ， 
。 祥 R440D 一 1680 8407 二 180857 7003 二 对 
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Algorithms andq Programs 





1，Compare the following approximations to jx) = er 


Taylor: 76(x) 一 工 十 二 世 克 
ay]lor: 6(x) 一 关 6 区 
12 十 6x 十 2X2 
: 民 二 一 一 一 一 
Fade 2.2(5) 12 6x 十 X2 


(a) Plot /Fax), 76(x), and R22(xz) on the same coordinate system. 
(b) Determine the maximum error that occurs when (xz) is approximated with 
76(r) and R2 2(x), respectively, over the interval [ 1, 1]. 
2.，Compare the following approximations to (xz) = In(1 十 x)， 


2 3 4 5 

Jaylor: 75(X) 一 X 本 十 本 元 十 本 
30x 十 21x2 十 X3 
P deE: 玉 一 一- 一- 
机 3200) 一 30 二 3936 十 9 


(a]。Plot /ax), 75(x), and R32(xz) on the same coordinate System. 
(b) Determine the maximum error that occurs when (xz) is approximated with 
75(x) and Ra3,2(x), respectively, over the interval [ 1, 1]. 


3，Compare the following approximations to _F(x) = tan(x). 


3 | 了 9 
苇 2 17x 62x 
or 0 一 本 二 3 
94Sx ”10Sx3 十 x5 


Pade: 民 一 gd 45nr27 TS 4 
ad6 5.4(Gx) 945$ ”420x2 十 1Sx4 


(0 Plot /oo), BC),and R54(X) on the same coordinate system. 
(b) Determine the maximum error that occurs when F(xz) is approximated with 
79(xr) and R5,4(x), respectively, over the interval [ 1, 1]. 


4. Compare the following Padk approximations to xz) = sin(r) over the interval 


[ 1.2, 1.2]. 
166,320x ”22,260x3 十 551x5 
R5,4(r) 一 一 
1S(11,088 十 364x2 十 Sx4) 
Ra 11,511,339,840x “1,640,635,920x2 十 $S2,785,432x5 ”479,249x7 
7,.6 二 一 一 一 一 一 一 一 一 


7(1644,477,120 十 39,702,960x2 十 453,960x4 十 2,623x9) 


(a) Plot /zx), Rs4(x), and R7.6(X) on the same coordinate system. 
(b) Determine the maximum error that occurs when (xz) is approximated with 
R5,4(x) and R7,6(r), respectively, over the interval [ 1.2, 1.2]. 
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S.(a) Use equations (6) and (7) to derive R6.6(xz) and Rag sg(x) for F(x) = cosGC) over 
the interval [ 1.2, 1.2]. 
(b) Plot Fox), R6.6(z), and Rsgg(xz) on the same coordinate system. 
(ec) “Determine the maximum error that occurs when (xz) is approximated with 
R6.6(x) and Rg,gs(xj, respectively, over the interval [ 1.2, 1.2]. 


一 一 一 一 
Ra 





Curve Fitting 


Applications of numerical techniques in science and engineering often involve curve 
fitting of experimental data，For example, in 1601 the German astronomer Johannes 
Kepler formulated the third law of planetary motion, 7 = Cx3/2， where x is the dis- 
tance to the sun measured in millions of kilometers, 7 is the orbital period measured 
in days, and C is a constant，The observed data pairs (xz, 7) for the first four planets， 
Mercury, Venus, Earth, and Mars, are (S8, 88), (108, 225), (150, 365),and (228, 687)， 
and the coefficient C obtained from the method of least squares is C = 0.199769. The 
curve 7 = 0.199769x3/ and the data points are shown in Figure S.1. 


75S0 


500 了 = 0.199769 x3/2 


2530 


Higure S$.1 The least-squares fit 
7 = 0.199769x3/2? for the first four 
Xx planets using Kepler's third law of 
S0 100 130 200 planetary imotion. 





2S2 
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Least-squares Line 


In science and engineering it is often the case that an experiment produces a set of 
data points (xl1, y1),，...， (CN, y?N)，wWhere the abscissas {xkj are distinct， One goal of 
numerical methods is to determine a formula ”= (Gc) that relates these variables， 
Usually, a class of allowable formulas is chosen and then coefficients mnust be deter- 
mined. There are many different possibilities for the type of function that can be used. 
Often there is an underlying mathematical model, based on the physical situation, that 
will determine the form of the function, In this section we emphasize the class of linear 
functions of the form 


(JU > 一 jxr) 一 4xz 十 万 . 


In Chapter 4 we saw how to construct a polynomial that passes through a set of 
points，If all the numerical values {z],{ykj are known to several significant digits 
of accuracy, then polynomial interpolation can be used successfully; otherwise it can- 
not. Some experiments are devised using specialized equipment so that the data points 
will have at least five digits of accuracy，However many experiments are done with 
equipment that is reliable only to three or fewer digits of accuracy. Often there is an 
experimental error in the measurements, and although three digits are recorded for the 
values {xkj and { 闪 ,it is realized that the true value F(xh) satisfies 


(2) Cek) 三 凑 十 上 


Where ek is the measurement error. 

How do we find the best linear approximation of the form (1) that goes near (not 
always through) the points? To answer this question，we need to discuss the errors 
(also called deviaiioras or residrua 有 sy): 


(3) ek 一 jx 次 for 1<<N. 


There are Several norms that can be used with the residuals in (3) to measure how 
farthe curvey = j(x) lies from the data. 


(4) Maximum error: ”EC 站 = 1max ,人 ycoD 关中 ， 
1 
(3) Average error: 已 (JP = 广 乞 上]7 Ge 只， 
1 ， 1/2 
(6) Root mean square 瑟 2(J) 一 二 je | ) . 


The next example shows how to apply these norms when a function and a set of 
points are given. 
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Table $.1 Calculations for Finding EC and E2z( 户 for 
Example 5.1 





1.6xK 





个 昌 一 呈 一 








了 Example S.1， Compare the maximum error, average error, and rms error for the linear 
approximation y》 王 /Gxz) = 8.6 1.6x to the data points ( 1, 10)，(0, 9)，(1 7)，(2, 9)， 
(3, 4), (4, 3), (5,0), and (6， 1)， 

The errors are found using the values for xx) and ek given in Table .1. 


(7) ECP) = maxf0.2, 0.4, 0.0, 0.4, 0.2, 0.8, 0.6,0.0] = 0.8， 
(8) 忆 ( 亡 二 8.9 一 0.325， 

1.4NI? 
(9) E2(P) = (总 ) As 0.41833 


We can see that the maximum eror is largest and if one point is badly in error, its 
value determines -o(. 门 . The average error 开 1(P) simply averages the absolute value of 
the error at the various points. It js often used because it is easy to compute，The error 
FE2(P)is often used when the statistical nature of the errors is considered. 

Abest-fitting line is found by minimizing one of the quantities in equations (4) through 
(60). Hence there are three best-fitting lines that we could find, The third norm E2( 站 isthe 
traditional choice because it is much easier to minimize computationally. 国 


Findqding the Least-squares Line 


Let {(Cxk， 办)}w be a set of N points, where the abscissas {x] are distinct. The /east- 
Starey ji1ze y 三 Fx) 一 4xz 二 Bisthelinethat minimizes the rootr-mean-square error 
2(. 亡 ). 

The quantity 瑟 az( 记 will be a minimum 证 and only ifthe quantity N(CE2( 六 )2 一 
人 | (4 大 十 殖 其)2 is a minimum. The latter js visualized geometrically by mini- 
mizing the Sum of the squares of the verttical distances from the points to the line. The 
next result explains this process. 
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(xz 4xk + 已 ) 





Figure $.2 ”The vertical distances 
between the points {(Cck, W)}) and 
the least-squares line y 三 4X 十 卫 . 


克 


X1 22 7 XN-1 xN 


Theorem 5S.1 (Least-squares Line). Suppose that {(xk， yi)]A_i are N points, where 
the abscissas ft are distinct. The coefficients of the least-squares line 


y 三 4x 十 如 


are the solution to the following linear system, known as the ormaal egtatioms: 
N N N 
(本 4 十 人 号 一 XiD， 
上 =1 上 一 大 =1 
N AN 
ba 4 十 NB 一 》 了 闪 . 
类 一 天 一 1 


Proof Geometrically, we start with the line y = 4x 十 已. The vertical distance dk 
from the point (xzk， yy) to the point (xk, 4xk 十 B) onthelineis 丰 =|4x 丸 十 已 难 | 
(see Figure 3.2). We must minimize the Sum of the squares of the vertical distances 中 : 


(10) 


人 


人 
(GD EC4,B)= > (4x+B yo 一》 人 
K 一 1 K 一 1 


The minimum value of 有 (4, B) is determined by setting the partial derivatives 
05/04and35E/8 中 equalto zero and solving these equations for 4 and 下. Notice that 
fxkj and {W] are constants in equation (11) and that 4 and B are the variables! Hold 
刀 fxed, differentiate 已 (4, 妨 ) with respectto 4, and get 


8FE(4, 甩 久 从 
2 =》2(4xxr 十 有 B ypDGb 王 2》 (4 丰 十 Bzk 区区 ). 
大 一 1 天 一 


(12) 
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Table S.2 ” Obtaining the Coefficients for 
Normal Equations 








吕 jwwb 口 一 
S| 己 
一 已 有 上 wo 





Now hold 4 fixed and differentiate 无 (4, 有) with respectto 刀 and get 


05E(4, 有 D) 


AN 
一 一 -一 -一 2(4 卫 一 2 人 尼 。 
(13) (4 克 十 下 共 ) 记 大 十 五 只) 


Setting the partial derivatives equal to zero in (12) and (13)， use the distributive 
properties of summation to obtain 


人 六 信 AN 
(9 0=2 04 不 十 Bt 了 3 一人》 承 十 且 2 区 >》 区 冰 ， 
K=-1 大 一 1 大 一 1 大 一 1 


AN PN AAA 
(15) 0 王 》 (4 克 十 甩 ?6D=A》 砍 十 NB >》 只， e 
类 一 1 天 一 1 天 三 1 


Equations (14) and (15) can be rearranged in the standard form for a system and 
result in the normal equations (10). The solution to this system can be obtained by one 
of the techniques for solving a linear system from Chapter 3. However the method 
employed in Program 3.1 translates the data points so that a well-conditioned matrix is 
employed (See exercises). 


了 Example S.2. Find the least-squares line for the data points given in Example S.1. 
The sums required for the normal equations (10) are easily obtained using the values 
in Table 9.2. The linear system involving 4 and B is 


924 十 208 = 25 
204 十 883 = 37. 


SEC,. 5.1 LEBAST-SQUARES LINE . 257 


< Kigure S.3 The least-squares line 
y= 1.6071429x 十 8.6428571. 





The solution of the linear systemis 4 鲜 ”1.6071429 and 中 羡 8.6428$71. Therefore, the 
]least-squares line js (see Pigure S$.3) 


yy 一 1.6071429x 十 8.6428S71 加 


The Power Fit y = 4x4 


Some situations involve (xz) = 4xM, where M is a known constant. The exXample of 
planetary motion given in Figure 3$.1 is an example，In these cases there is only one 
parameter 4 to be determijned. 


Theorem S.2 (Power Fit),， Suppose that {(xk， Jr)] 人 1 are N points，where the ab- 
Scissas are distinct，The coefficient 4 of the least-squares power curve y》 = 4xM is 
given by 


0E 


Using the least-squares technique, we seek a minimum of the function E(4): 


入 
(7) E(4) = 》 (4x 如 yi) 
大 一 1 


In this case it will suffice to solve 已 (4) = 0. The derivative js 


人 人 
(18) E(4)=2》(hxzl yet =2》 (hxgM xl 
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Table $S.3 ”Obtaining the Coeffcient for a Power Fit 


Distance, 居 专 达 







Time, 灵 





7.68680 


Hence the coeffticient 4 is the solution of the equation 


和 N 
(19) 0=4》 克 4 》 xl 
大 一 1 大 一 1 
which reduces to the formula in equation (16). 


Example S.3， Students collected the experimental data in Table 5$5.3，The relation is 
d 王 和 8 where d is distance in meters and f is time in seconds. Find the gravitational 
constant 8. 

The valuesin Table 5.3 are used to fndthe summations required in formula(16), where 
the power used is AM = 2. 

The coefficient is 4 = 7.68680/1.5664 = 4.9073, and we get d = 4.907313 and 
8 一 24 = 9.7146 my/sec”. 加 


The following program for constructing a least-squares line is computationally sta- 
ble: it gives reliable results in cases when the normal equations (10) are iconditioned. 
The reader is asked to develop the algorithm for this program in Exercises 4 through 7. 


Program 5S.1 (Least-squares Line)，To construct the least-squares line y 一 47 十 


姥 that fits the N data points (xl1, y1)，...，(xN，yN). 





function [A,B]=1sline(X,Y) 


%Input - X is the lxn abscissa Vector 

久 -YY is the lxn ordinate Vector 

%Dutput - A is the coefficient of x in Ax +B 

人 - B is the constant coefficient in Ax + 了 
Xmean=mean(X) ; 

ymean=meankY) ; 


Sumx2= (X-Xxmean)* (X-Xxmean)，; 
Sumxy=(Y-ymean)*(X-Xxmean) :; 
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A=sumxy/Vsumx2 ; 
B=ymean-A*Xmeamn 


了 Exercises for Least-squares Line 





In Exercises 1 and 2, find the least-squares line y = jx) = 4x 二 Bforthe data and 
calculate 五 2( 万 ) 


1. (3) 








(b) 


JK 


(C) 


2、(a) (hb) 





(C) 








3. Find the power fit y = 4x, where M = 1, which is a line through the origin, for the 
data and calculate 五 2(. 户 ). 


260 CHAP. SS CURVEEFITTING 


(a) (b) 





(c) 





4、Deftine the means7X andy forthe points {(xk， yj by 


5 5 
基 三 一 MK and = 一 其 . 
各 AN 怎 | 


Show that the point (xz, ) lies on the least-squares line determined by the given set of 
points. 


S$。 Show that the solution of the system in (10) is given by 


天 一 1 天 一 1 天 一 工 
1 人 六 太 人 
(这 2 这 立 =n 
大王 1 天 一 上 类 一 1 大 =1 


where 


ipt Use Gaussian elimination on the system in (10). 


6。Show that the value of D in Exercise 9 is nonzero. 
Hint Show that 刀 =Ny AIGCK 习 ?2. 


7. Show that the coefficients A and 有 B for the least-squares line can be computed as 
follows. First compnute the means 克 and y in Exercise 4, and then perform the calcu- 
lations: 


AN AN 
1 
C=》(x 有 习 2， 4= 二 >》 元 尺 ， 下 = 了 了 4 
名 全 ) 5 名 爷 )COKE 了 了 
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Bint Use MX 一 大 多 一 你 yandfirstfndthe line 了 一 4X. 


。Find the power fits 》 一 4x2andy 一 Bx3forthe following data and use 开 2( 太 ) to 


10. 


11. 


12 


determine which curve fits best. 


(a) 人) 





Find the powerfits y = 4/x andy = B/xz2zforthe foljlowing data and use E2( 站 to 
determine which curve fits best. 


(3a) (b) 





(a) ”Derive the normal equation for finding the least-squares linear fit through the 
origin y 三 47x. 


(bb Derive the normal equation for finding the least-squares power fit y = 4x2. 
(c) ”Derive the normalequations forfinding the least-squares parabola y = 4X?2 十 吾 . 


Consider the construction of a least-squares line for each of the sets of data points 
determined by SN = 【{( 乞 ， 专 )] 人 where N 二 2,3,4,...， Note that for each 
value of N the points in Sw all lie on the graph of F (xz) = x2 over the closed interval 
[0, H, LetXN and yN be the means for the given data points (see Exercise 4). Let 侈 
be the mean of the values of x in the interval [0, 1], and let y be the mean (average) 
value of Fr) 三 X2 over the interval [0, 1]. 


(3)》 Show limxw_>oo XN 二 多 
(b) Show limw_ coyN = 分 


Consider the construction of a least-squares line for each of the sets of data points: 


大 大 
5 =[( aa 广 +a 7 ao+O)] 


for N = 2, 3,4,...… Assumethaty 一 jx)is anjintegrable function over the closed 
interval [a, 让. Repeat parts (a) and (b) from Exercise 11. 
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Algorithms and Programs 





1。Hooke's law states that 严 = KY，Where Fis the force (in ounces) used to stretch 
a Spring and x is the increase in its length (in inches). Use Program 5S.1 to fnd an 
approximation to the spring constant K for the following data. 


(9) (D) 





2。 Write a program to find the gravitational constant 8 for the following sets of data. Use 
the power fit that was shown in Example 5.3. 
(b) 


Distance, 雁 Time, 灰 Distance, GK 





3.。 The following data give the distances of the nine planets from the sun and their side- 


real period in days. 
Distance from 
Sun (km X 100) 






9Sidereal period 
(days) 










Mercury 

Venus 224.70 
Earth 365.26 
Mars 686.98 
Jupiter 4,332.4 
Saturn 10,7S9 
Uranus 30,684 
Neptune 60,188 
Pluto 90,710 


Modify your program from Problem 2 to also calculate E2(P 记 Use it to find the 
power fit of the form y = Cx3/? for (a) the first four planets and (b) all nine planets. 


4. (a) ”Find the least-squares line for the data points {(xk, 站 )] 和 0， where 太一 (0.1 
and 光一 xx 十 cos(K1/2)， 
(b) Calculate 天 2 (万 ). 


(@) Plot the set of data points and the least-squares line on the same coordinate 
System. 
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Data Linearization Method for y 三 Ce4z 


Suppose that we are given the points (xl1, y1),， (xz2，y2),，.,，(xN YN) and wanttofit an 
exponential curve of the form 


(D) yy 一 Ce4. 

The first step is to take the logarithm of both sides: 

(2) ln(y) = 4xz 十 jn(C). 

Then introduce the change of variables: 

(3) 7 了 =In)， X=x， and 也 =jn(C)， 
This results in a linear relation between the new variables X and 了 : 
(4) 了 一 AX 十 用 


The original points (xk, 次 ) in the xy-plane are transformed into the points (X ,也 ) 一 
(ck In(yr)) in the XY-plane. This process is called data 1izzearizatiom. Then the least- 


Squares line (4) is fit to the points {(Xk, 隐 )}. The normal equations for fnding 4 and 
呈 are 


G) 


AN 人 人 

公 本 4 (本 有 = 》 XkJk， 
大 一 1 大 一 ] 《一 1 
AN 

昌 呈 ) 4 十 NB = 

大 一 1 


N 
After 4 and 有 have been found, the parameter C in equation (]) is computed: 


》 玖 . 
(0) C =e3. 


大 一 1 


Example S.4. Use the data linearization method and find the exponential ft y = Ce4 
for the five data points (0, 1.5), (1, 2.3), (2, 3.5$), (3, S.0), and (4, 7.5)， 
Apply the transformation (3) to the original points and obtain 


O {k Di = (0 in(1.3) (1 In(2.3)), (2,]n(3.9)), (3, ln(3.0)), (4, ln(7.5)) 
= {(0,0.40547), (1, 0.91629), (2, 1.23276), (3, 1.60944), (4, 2.01490)}. 


These transformed points are shown in Figure 5.4 and exhibit a linearized form. The equa- 
tion of the least-squares line 了 一 4 瑟 十 召 forthe points (7) in Figure $.4 is 


(8) 了 = 0.391202X 十 0.457367， 
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了 
2.0 
1.5 了 = 4X + 如 
1.9 
0.5 
和 Kigure S.4 The transformed Gata 
0 2 3 4 Points {(Xe， 了 


Tabie 54 DObtaining Coefhcients of the Normail Equations for the Transformed Data Points 
人 Xe 玖 证 






0.060000 












0.916291 
2.0 2.505S26 
3.0 :4 4.828314 
4.0 2.014903 16 8.0596E2 






16.309743 
一 2 下 


10.0 6.198860 30.0 
一 了 有 一 人 多 = 于 寻 


Caicualation of the coc 和 acients for the hormal equations ia (S) is shown in Table 35.4. 
The restiting liaear System (3) for detetmining 4 and 妃 is 


304 二 108 = 16.309742 


9 
名 104 十 5 有 6.198860. 


The solution is 4 = 0.3912023 and 旦 一 0.437367. Then C is obtained with the calcuiation 
C = e0457367 = 1.579910, and these values for 4 and C are substituted into equation (1T) 
to obtain the exponential fit (see Figute 5S.3) 


(10) ? 一 下 .79910e9.3912023< (fit by data Hnearization). 机 
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Figure S$.S The exponential fit 
x yy= 1.379910e03912023x obtained by 
using the data linearization method. 





Nonlinear Least-squares Method for y = Ce4x 


Suppose that we are given the points (xz1,， yt),， (x2，y2),...， (CN, YN) and wantto fit an 
exponential curve: 
(11) ?了 一 Ce4r， 


The nonlinear least-squares procedure requires that we find a minimum of 
N 
(12) E(4,C) = 一》 (Ce4a JU) 
大 一 1 


The partial derivatives of 忆 (4, C) with respectto 4 and C are 


9 XU 
(13) 议 =22 (Ce DCxkee) 
类 一 1 
and 
3 忆 X xz 
(14) 元 =22_ (Ce 和 5 (4 
大 一 1 


When the partial derivatives in (13) and (14) are set equal to zero and then Simplified， 
the resujting normal equations are 


人 站 
C De 》， 贡 Jre4 = 0， 
| 人 1 


(15) 人 辣 
C 》， e4x ke 人 = 0， 
天 = 天 一 1 
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The equations in (19) are nonlinear in the unknowns 4 and C and can be Solved using 
Newton's method. This is a titme-consuming computation and the iteration involved 
Tequires good starting values for 4 and C，Many software packages have a built-in 
minimization Subroutine for functions of several variables that can be used to minimize 
E(4,C) directly, For example, the Nedler-Mead Simplex algorithm can be used to 
minimize (12) directly and bypass the need for equations (13) through (15). 


Example S.S。 Use the least-squares method and determine the exponential fit y = Ce4z 
for the five data points (0, 1.3), (1, 2.5), (2, 3.3), (3, $.0), and (4, 7.5). 
FEor this solution we mnust minimize the quantity E(4, C),， which is 


FE(4,C)=(C 15 二 (Ce4 2.5)2 二 (Ce24 3.5) 


(16) 
二 (Ce34 5.02 十 (Ce44 7.5)2. 


We use the fmins command in MAILAB to approximate the values of 4 and C that mini- 
mize 无 (4,C). First we define 下 (4,C) as an M-file in MATLAB. 
function Z=E(uy) 
A=u(Cl) ; 
C=u(2) ; 
zZ=(C-1.5) .2+(C.*exp(A)-2.5).”2+(C.kexp(2+A)-3.5) .>~2+... 
《C .*kexp(3*+A)-5 .0) ,~2+(C.*xexp(4*A)-7.5). ~2; 


Using the fmins command in the MATLAB Command Window and the initial values 
4=1.0andcC = 三 1.0.wefnd 
>>fmins(2E?,[1 ) 
angs = 

0.38357046980073 1.61089952247928 


Thus the exponential fit to the five data points is 
(17) ?一 1.610899$e0.3835705 (ft by nonlinear least squares). 


A comparison of the solutions using data jlinearization and nonlinear least Squares is 
given in Table 3.3，There is a slight difference in the coefficients，For the purpose of 
interpolation it can be seen that the approximations differ by no more than 2% over the 
interval [0, 4] (see Jable 9.3 and Figure $.6). If there is a normal distribution of the errors 
in the data, (17) is usually the Preferred choice， When extrapolation beyond the range of 


the data is made, the two solutions will diverge and the discrepancy increases to about 6% 
whenx 三 10. 。 国 


Transformations for Data Linearization 


The technique of data linearization has been used by scientists to fit curves Such as 
= Cel4oy= 4ln(xz) 十 好 ,andy 一 4/x 十 下 .Oncethe curvehas been chosen， 
a Suitable transformation of the variables must be found so that a linear relation is 
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Table S.S ”Comparison of the Two Exponential Fits 


].5799e0.39120x 


1.5 1.5799 









1.6109e03835 人 





5.0 11.1716 10.9644 
6.0 16.5202 16.0904 
7.0 24.4293 23.6130 
83.0 36.1230 34.6S27 
9.0 53.4202 50.8335 


78.9955 74.6287 


了 
80 
60 
40 
20 
x FEisgure S.6 A graphical compari- 
0 2 4 6 8 10 。 son of the two exponenftial curves. 


obtained，For example, the reader can verify that y = D/Gx + C) is transformed 
into a linear problem 了 = 4X 十 收 by using the change of variables (and constants) 
和 =XZy 了 了 =》C= 1/4,andD = 8/4. Graphs of several cases of the 
Possibilities for the curves are Shown in Figure 9.7, and other useful transformations 
are given in Jable 5.6. 


Linear Least Squares 


The linear least-squares problem is stated as follows，Suppose that N data points 
{Ccky and a set of M linear independent functions {.P(z)} are given，We want 
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万 ~1 3 
= 一 一 一 ;， 4= 一 ,了 B=1 =41] + 号; 4=2,= 一 =41 + 了 ;4=-2,8=2 
7=AT 矶 4 5 ? n(O 了 》 noD) 
1 2 1 3 
二 4z， 一 一 ， 一 一 二 4x， 4=-1， = 了 三 4; 4= 二 ，C= 一 
?= Ce 4 本 C 5 y= Ce C y= Cx 了 C 5 





4=4,B=-3  y= Cxe-pxC=12D=1 》 艺 =S,C=20,4=-2 


1+ Ce 


Figure S.7 ”Possibilities for the curves used in “data linearizatiom”. 
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Table S.6 ”Change of variable(s) for Data Linearization 


Function, y = 三 (zx) Linearized form, 了 一 4x 十 五 Change of variable(s) and constants 











1 
7 一 一 十 瑟 7 一 4 一 十 了 区 一 一 ,了 一 
万 交 大 
= 一 + 一 oo)+E 和 一 xy, 了 一 
7 一 x+C 7 二 2 二? 
1 怪 
CA2=- 人 
1 
一 忆 一 一 一 
7 AxX 十 如 并 ?》 
其 1 1 
一 瑟 一 一 ,了 一 一 
了 4x 十 吾 大 y 
7 三 4ln(x) 十 召 y=4ln(x) 十 妃 和 =ln(0), 了 了 =》 
= Ce4z lnO) = 4xz 十 In(C) X=xz7=lno) 
C=e3 
一 Cx4 ImO) = An(Cx) +ln(C) X =Imo), 了 =ln0) 
C 一 e28 
y 了 一 (4xz 十 瑟 “ 》 LU2 = 4xz 十 厂 和 = 了 一》 L2 
?一 Cxe Dzx PDxr +ln(C) 和 一 x, 了 一 in (=) 
尼 
C=ea,D= | 
_ 了 中 4xr 十 ln(C) 站 了 一 1 上 1 
一 一 有 了 一 邯 ， 一 jn| 一 
7 1 十 Ce4z y 


C = eB and is aconstant 
that must be given 





to find M coefficients {cj] so that the function 让 (x) given by the linear combination 


&4 
(18) Fo = > cj700 
j=1 


will minimize the Sum of the squares of the errors 


和 N M 4 
(19) 。 尼 (cu cz cao) = 》 (Geb =(( 半 ape 中 
KK 一 1 


天 一 1 一 1 
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FEor Eto be minimized it js necessary that each partial derivative be zero (1.e.， 
05E/3ci =0fori =12,...,，M),andthis results in the System of equations 


人 


ad 
(20) (( 关 oo *] (ha =0 fori=1 2，...，1M. 
Jj 一 ! 


类 一 1 


Interchanging the order of the summations in (20) will produce an M x M system 
of linear equations Where the unknowns are the coefficients {cj). They are called the 
normal equations: 


4 


人 人 
CD  》， 得 heomieo cj 一》 上 xb fori 一 1 2 .…，M. 
天 一 1 类 一 1 


Jj=1 


The Matrix Formulation 


Although (21) is easily recognized as a System of AMf linear equations in M unknowns， 
one must be cjever so that wasted computations are not performed when writing the 
System in matrix notation. The key is to write down the matrices 环 and 环 ' as follows: 


AD 户 xD …， Jean 
(2) 户 2) Jp) 


屯 一 | 3) 户 x3) Ja3) 


Jim 户 kw) FrvGw) 


JeD Je2) as) … CN) 
到 二 PaD Poec) Pa) …， 户 CN) 


Jp Ja Ja) …， JrGCw) 
Consider the product of 严 ' and the column matrix 了 : 


PC ho) 3) …， GCCN) | | 太 


(22) 兢 / 了 二 Per j2C2) 7Ca) ，, ， 户 Cem) 


JUNGCUD Jo2) Je3) … Jaw) | yw 
The element in the ;th row of the product Y in (22) is the same as the ;th element in 


the column matrix in equation (21); that is， 


(23) >》 廊 kDz=row 杞 [72 yw] 
| 
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Now consider the product 环 下, which is an M x M matrix: 


丈 ' 太 一 
JacD .Pen …， JpnGD 
he AhAGeo) 六 3) 万 CN) 
PeUD Poa) 忆 03) …， 户 CN) 帮 C2) PC2) Je) 
- 太 G3) 户 03) Ja3) 
Jr xl) JAh(Cc2) Jr (03) 2 JrGCN) Poem 户 CoN)  。 yn 


The element in the ;th row and jth column of 素 'F is the coefficient of cj in the 
ith row ip equation (21); that ls， 


RN 
(24) > ， Job = ec 万) 二 2) 万 (2) 十 十 户 CN) 记 (xzN). 
大 一 | 


When M is small, a computationally effhicient way to calculate the linear least-squares 
coefficients for (18) is to store the matrix 玉 , compute 下 下, and 太 ' 了 and then solve 
the linear System 


(25) FFC = 天 forthe coeffcient matrix  C. 


Polynomial Fitting 


When the foregoing method is adapted to using the functions { Po) 一刀 贡 andthe 
index of summation ranges from / = 1to ) = M +1,the fonction Flz) winbea 
polynomial of degree M: 


(20) (xz) 一 cl 十 c2x 十 Ca3X2 十 … 十 CMAHIX4 


We now show how to find the /east-sqgrares parwpola, and the extension to a poly- 
nomial of higher degree is easily made and is left for the reader, 


Theorem 5.3 (Least-squares Parabola)， Suppose that {(xzk, yD)]A_ 1 are N points， 
where the abscissas are distinct, The coefficients of the least-Squares parabola 


(27) ?>= fr) =4x2z 二 Bx 二 C 


are the solution values 4, B ,and C of the linear system 


( 4+ (2 B+ (本 cy wo 


KK 一] 


N AN N N 
(28) 人 中 有 十 得 本 妨 十 过 = C 一 YX 
大 


一 一 一 一 -一 一 一 一 一 一 一 
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Table S.7 ”Obtaining the Coefficients for the Least-Squares Parabola of Example 5.6 








Proof The coefficients 4, B, and C will minimize the quantity: 


人 
(29) E(4,B,C) = 》 (4 对 十 互 下 十 C 其) 
天 一 1 


The partial derivatives 9 有 E /34,95/0B,and 95E/oC must all be zero. This results in 


3F(4, BC) 人 
0= -一生 一 2 人 4 于 + Bi 十 C yi)IGC 人 ， 
3E(4, 有 ,C) 必 ， 1 
(30) 0= 一 六 一 =? 人 4 十 B 丰 十 C WIICA， 
9E(4,B,C) w  ， 1 
0= 一 沁 =22 .04 克 +Bt 二 TCDD， 


天 一 1 


Using the distributive property of addition，we can move the values 4, 有 , and C 
outside the summations in (30) to obtain the normal equations that are given in (28). 。 


Example S$.6， Find the least-squares parabola for the four Points ( 3, 3)，(0, 1)，(2,，]1)， 
and (4, 3)， 


The entries in Jable 5.7 are used to compute the Summations required in the linear 
System (28). 
The linear system (28) for finding 4, B, and C becomes 
3534 十 458 十 29C = 79 
454 十 298 十 3C= 5 
294 十 38 十 4C= 8. 


The solution to the linearsystem is 4 = S8$/3278, 刀 = 6031/3278,andC 三 1394/11639， 
and the desired parabola is (see Figure .8) 


385 》〉 631 1394 


一 一 一 一 一 x 十 一 一 一 0.178462x?2 ”0.192495x 十 0.850519. 
7 一 32785 377871655 二 08350519 ” 
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Figure $.8 The least-squares 
Parabola for Exampie .0. 





了 Polynomial Wiggle 


Itis tempting to use a least-squares polynomial to fit data that is nonlinear, But if the 
data do not exhibit a polynomial nature, the resulting curve may exhibit large oscilla- 
tions. This phenomenon, called polymromzial wiggle, becomes more pronounced with 
higher-degree polynomials. For this reason we seldom use a polynomial of degree 6 or 
above unless it is known that the true function we are working with is a polynomial. 

For example, let fx) = 1.44/x2 十 0.24x be used to generate the six data points 
(0.25, 23.1), (1.0, 1.68), (1.5, 1.0)，(2.0, 0.84)，(2.4, 0.826), and (5.0, 1.2576). The 
result of curve fitting with the least-squares polynomials 


户 (x) = 22.93 16.96x 十 2.5$3x2， 
P(x) = 33.04 46.51x 十 19.51xz2 2.296x3， 
户 (xz) = 39.92 80.93x 十 58.39x2 17.1Sx3 二 1.680x4， 


and 


Pi(x) = 46.02 118.1x 十 119.4x2 57.51x3 二 13.03x4 1.08Sx5 


is shown in Figure $.9(a) through (d). Notice that 户 (z)，P4Gx), and 疡 (xz) exhibit a 
large wiggle in the interval [2, $S]. Even though 疡 (x) goes through the Six points, 放 
produces the worst fit. If we mnust fit a polynomial to these data, 疡 (x) Should be the 
choice. 

The following program uses the matrix 已 with entries 记 (z) = xy7 1 from equa- 
tion (18)， 
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人 





(g) 


站 gure $.9 (aa) Using 户 (x) to fit data. (b) Using 户 (x) to fit data. (c) Using PCx) to 
fit data. (d) Using 上 杨 (xz) to fit data. 





Program 5S.2 (Least-squares Polynomial). To construct the least-squares polyno- 
mial of degree M of the form 


PiMf(x) 三 Cl 十 C2X 十 c3x2 十 … :十 Ca 1 十 CrHIXM 


that fits the N data points {(xk， 区)}_1. 


function C = 1spoly(X,Y,M) 





XInput  - X is the 1xn abscissa vector 

包 -YY is the lxn ordinate Vector 

- M is the degree of the least-squares Polynomnia 
% M is the deg f the 1 d Polynomial 
% Output - C is the coefficient list for the polynpomial 


Dn=length(X) ; 
B=zeros(1:M+1) ; 
F=zeros ( 卫 ,M+1) ; 
XMFill the columns of F With the powerSs of X 
for k=1:M+1 
F(: ,KK)=X; .~(Kk-1) ; 
end 


YXSolve the Linear System from (25) 
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A=F?:*F; 
B=F?*Y，; 
C=ANB; 
=flipud(C) ; 


Exercises for CuUrve Kitting 





1。 Find the least-squares parabola (xz) = 4xz2 上 + Bx 十 C foreach set of data. 
(9 (b) 





2。Find the least-squares parabola F(x) =- 4x2 十 Bxz 十 Cforeach set of data. 
(3a) (b) 





3. For the given Set of data, find the least-squares curve;: 
(a) (xz) 一 Ce4， by using the change of variablesX = x, 了 = In(y),andC = eD， 
from Table 5.6, to linearize the data points. 
(oo = Cx4, by using the change of variables X 一 jn(x), 了 = jn(y), and 
C = e, from Table $.6,to linearize the data points. 
(C) Use Fa2( 站 to determine which curve gives the best fit. 
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4. For the given set of data, find the least-squares curve;: 


(aj jx) = Ce4x,byusingthe change ofvariablesX = x, 了 一 ln(y),andC = ea， 
from Table $.6, to linearize the data points. 


(pb) jx) = 1V(C4r 十 盏 ), by using the change of variablesX 一 xandy 一 1/y， 
ffom Table 9.6, to linearize the data points. 


(cj) Use FE2(P) to determine which curve gives the best fit. 





S。For each set of data, find the least-squares curve: 


(a) FFCx) = Ce4x,by usingthe change of variablesX = x, 了 一 ln(y),andC = e?， 
from Table $.6, to linearize the data points. 


(b) fx) = (4x 十 刀 “,by using the change of variablesX 二 xzandy = 一》 102， 
from Table $.6, to linearize the data points. 


(c) Use FE2(J) to determine which curve gives the best 人 it. 





人 ( 拘 
LK 其 
1 13.65 
0 1.38 
1 0.49 
3 0.15 








人 


Lo8gistic popuilation growth，。 When the population P(D is bounded by the limiting 
value ZL it follows a logistic curve and has the form P() = 工 /(1 十 Ce4). Find 4 
and C for the following data, where 工 is a known value. 


(a) 《〈0, 200), (1, 400), (2, 650), (3, 8$0), (4, 950), and 工 = 1000. 
(b) “〈0, 500), (1 1000), (2, 1800), (3, 2800), (4, 3700), and 工 = S000. 


7.、Use the data for the U.S. population and find the logistic curve _P()，Estimate the 
population in the year 2000. 
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(a) Assume that 世 一 8 x 108 (bj) Assumethat 工 =8x 108 








In Exercises 8 through 15, carry out the indicated change of variables in Table 5.6, and 
derive the linearized form for each of the following fnctions. 








8. 一生 十 9 ?= 
10. y = 1 11.y 一 

A4xX 十 召 4 十 有 Bx 
12.y= 4ln(x) 十 瑟 13. = Cx4 
14. = (hx 十 B) 1S.y 一 Cxe Pr 


16. (a) Follow the procedure outlined in the proofof Theorem .3 and derive the normal 
equations for the least-squares curve F(x) = 4cos(x) 十 Sin(x)， 


(bp Use the results from part (al to find the least-squares curve 让) 三 4cos(X) 十 
玉 sin(x) forthe following data: 





17. The least-squares Planez = 4xzx 十 By 二 +Ctforthe NM points (xl, yl zi)，.. 
(xzN, yN, ZN) is obtained by minimizing 


人 
BE(4,B,C)=》 (4 十 BTTC  z07 
类 一 1 
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Derive the normal equations: 


KK 一 1 大 一 1 大 一 | K=1 
AN 尽 站 人 
必 so] 4 站 已 十 必 虽 C 一 23 
天 一 1 大 一 1 K 一 1 K=1 
尺 AN 从 
(本 4 十 (9 BA+NC 一 >》 zt 
天 一 天 一 1 类 =1 


18。Find the least-squares planes for the following data. 


二 (1 7 (29 02110), (022 110D,(2, 3, 12) 
(b) (1, 26), (2, 3, 7), (1 18), (2,2, 8), (2,1,9) 
(O] (3, 1，3), (2, 1，1,(2,2,0), (1 1 1 (1 2,3) 


19. Consider the following table of data 





When the change of variables X = xy and7 = 1/y are used with the function 
= D/GC 二 C),the transformed least-squares fit is 
17.719403 

”7 5476617- 
When the change of variables X =Y and 了 = 1/y are used with the function 》 一 
1/(4x 十 了 ),the transformed least-squares fit is 

1 
0.1064253x 二 0.4987330- 

Determine which fit is best and why one of the solutions is completely absurd. 


y 一 


Algorithms and Programs 


Ce er CC | 


1、The temperature cycle in a suburb of Los Angeles on November 8 is given in the 

accompanying table below. There are 24 data points. 

(8) ”Folow the procedure outlined in Example 5.5 (use the fmins command) to find 
the least-squares curve of the form (xz) = 4cos(Bx) 十 Csin(Dx)forthe given 
Set of data. 
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(b) Determine 五 2( 广 ). 


(cj)  Plot the data and the least-squares curve from part (a) on the Same coordinate 
System. 






Time, p.m. | pegrees | Time, a.m，| Degrees 





四 加 让 了 人 上 四 明 一 
DG 了 宁 wmewmwi 一 


让 
扩 人 
一 
一 己 
CN 
蕊 让 


Midnight 


JInterpolation by Spline Functions 


Polynomial interpolation for a set of N 十 1 points {(xk， yp)] 人 0 is frequently unsatis- 
factory. As discussed in Section $.2, a polynomial of degree N can have N 1lrelative 
maxima and minima，and the graph can wiggle in order to pass through the points. 
Another method is to piece together the graphs of lower-degree polynomials Sr(x) and 
interpojate between the Successive nodes (xk， 次 ) and (Xk+1, 1) (See Figure S.10). 


Ce yy 






Gy ?2) CN_- TIJN- 1) 


kr +D 


X0 XI 22 放 人 +1 XN-1 YN 


Figure S.10 ”Piecewise polynomial interpolation 
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Ce y) 





Cnw_-byw-D) 





Cw yN) 
一 上 一 十 下 一 一 一 六 二 和 一 一 十 一 区 
2X0 XI 7X2 人 XK+1 XN-1 YXN 


Figure S$.11 Piecewise linear interpolation (a linear spline). 


The two adjacent portions of the curve 》 三 Sk(r) and 》= SHIC),， Which lie apove 
[xx xz] and [t+1, xk2], respectively,pass through the common Kmzot (x+1， 闪 +1)， 
The two portions of the graph are tied together at the knot (xzk+1, +1D， and the set of 
functions {Sk(x)} forms a piecewise polynomial curve, which is denoted by S(x). 


Piecewise Linear Interpolation 


The simpjlest polynomial to use, a polynomial of degree 1, produces a polygonal path 
that consists of line segments that pass through the points. The Lagrange polynomial 
from Section 4.3 is used to represent this piecewise linear curve: 


多 3 十 1 二 MK 
(]) SC) = 捧 一 十 WH 一 一 for 克 生 X < 区 +1. 
了 MXK+1 多 二 了 


The resulting curve looks like a broken line (see Figure 3.11). 
An equivalent expression can be obtained 详 we use the point-slope formula for a 
line segment: 


SC) 一 其 十 疏 人 其 )， 


where f 一 (yi /GCT 不) The resulting Zear Spinae function can be 
written in the form 


y0 十 do 20) forx in [xo, xl]， 

71 十 KxX1) forxz in [xl, x2]， 
(2) SC) 一 

天 十 故人 3) for x in [xx xk+i， 


yN 1+Tadnw 1 xxN 1 forxzinfxw 1,xN]. 
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The form of equation (2) is better than equation (1) for the explicit calculation of 
Sr). It is assumed that the abscissas are ordered x0 < X < …… <XN 1<XYN. For 
a fxed value of x, the interval fxk, x+1] containing x can be found by Successively 
computing the differencesxy xl .7 Mk xxXk+luntilk 十 1isthe smallest 
integer such that x ”Xik+1l < 0. Hence we have foundK so that xf < x 过 共 Tt and 
the value of the spline fonction $(x) js 


(3) 00) 一 SiX) 三 次 十 中 区 ) for 称 么 X 苹 区 二 1 


These techniques can be extended to higher-order polynomials. For example, 放 an 
oqdd number of nodes x0,xl,...，,xX2M is given， then a piecewise quadratic polyno- 
mial can be constructed on each subinterval [x2k, X2k+2], for 大 三 0, 1 ...，hM 1. 
Ashortcoming of the resulting quadratic Spline is that the curvature at the even nodes 
xX2k changes abruptly, and this can cause an undesired bend or distortion in the graph. 
The second derivative of a quadratic spline is discontinuous at the even nodes. If we 
use piecewise cubic polynomials, then both the first and second derivatives can be 
Imade continuonus. 


Piecewise Cubic Splines 


The fitting of a polynomial curve to a set of data points has applications in CAD 
(compnuter-assisted design)，CAM (computer-assisted manufacturing)，and computer 
graphics systems. An operator wants to draw a smooth curve through data points that 
are hot subject to errof. Traditionaly, it was common to use a french curve or an ar- 
chijtect's spline and subjectively draw a curve that looks smooth when viewed by the 
eye Mathematically, it is possible to construct cubic functions Si (xz) on each inter- 
Val [xt, 允 +1] So that the resulting piecewise curve y》 = SC) and its first and second 
derivatives are al continuous on the larger interval [xo, xy] The continuity of S (0) 
means that the graph y 三 $(x) will not have sharp corners. The continuity of $S7(x) 
means that the 7adixs of curvatuye js defined at each point. 


Definition S.1 (Cubic Spline Interpolanf). Suppose that {(xk， 共 )) 人 0 areN 十 1 
Points, wherea = X0 < xl < …' <xXN 三 DThe function SO is called acrpic 
SPplirze 这 there exist N cubic polynomials St(xz) with coefficients % 0， SK,T，SK, 2，3and 
sk,3 that satisfy the properties: 


I SC) 一 SO 一 了 0 十 SI AD) 十 呈 20 其 大 十 中 3 不 )3 
forx e [x+ and 大 三 0,1...,N 1 


了 芋 。 S(Cxk) 一 其 for 大 = 0, 1 ...，N. 

HE，Sk(xk+l) 一 SIOCKA+T) for 三 0,1...,N 2. 
IV， Stxk+D = SHIC+D forK 一 0,.1...,N 2， 
YV SLCKT1) 一 SiCkt+D) for 上 =0,1...,N 2. 
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Property I states that S(x) consists of Piecewise cubics. Property II states that the 
piecewise cubics interpolate the given set of data points. Properties II and IV require 
that the piecewise cubics represent a Smooth continuous function，Property V states 
that the second derivative of the resujlting function is also continuous，. 


了 Existence of Cubic Splines 


Let us try to determine if it js possible to construct a cubic spline that satisfies proper- 
ties Ethrough V. Each cubic polynomial Sk(x) has four unknown constants (Sk.0，5Sk 1 
sr.2，and 5 ,3); hence there are 4N coefficients to be determined，Loosely speaking， 
we have 4N degrees of freedom or conditions that must be specified. The data points 
Supply N 十 1 conditions, and properties HL, IV, and V each supply N ”1 conditions. 
Hence, 十 1I+3(VN 1HD=4N 2conditions are specified. This leaves us two addi- 
tional degrees of freedom. We will call them ezd-potzat co7tstzai7its: they will involve 
either 9 (xz) of S (xz) at x0 and xN and will be discussed later，We now proceed with 
the construction. 

Since (xj is piecewise cubic, its second derivative 8 (x) is piecewise linear on 
[xo, xw]. The linear Lagrange interpolation formula gives the following representation 
for S (xc) = SVCD): 

() So0 = SCD 一 LS tt 一 -全 
允 了 +H1 2XK+1 大 


Use 1 一 SCxk)， 1JK+1 一 3 (zk+1)， and 礁 一共 HL 了 允 iD(4)to get 


HZ 天 jj 十 1 
(5) So0D = 一 (xl 可 十 一 (了 
大 及 大 
forx <x<xk+Hland 一 0,1...,N 1.Integrating(S) twice will introduce two 


constants of integration, and the result can be manipulated so that it has the form 


1 天 有 天 
(9) SC = 二 Cl 3 十 一 xx 十 区 Ge 困 十 和 xD)， 
6GHK 6 


Substituting xx and x+l into equation (6) and using the values 从 = SkOxk) and 
+l = SCk+1) yields the following equations that involve Pk and dgk, respectively: 


JI 177 
(7) 六 三 民 十 Pr and 其 +l 一 一 拓 十 9KA. 


These two equations are easjly solved for pk and gxk, and when these values are sub- 

stituted into equation (6), the result is the following expression for the cubic function 

KE(XC: 

2 十 1 《 
OA 


(9) 
11218 JI1 严 
+ ( 关 Pi 处 :] ee 站 (2 Te] 2 


1 
SOD= 大 Girl 可 二 


6 FF 6 
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Notice that the representation (8) has been reduced to a form that involves only 
the unknown coefficients {mzx}. To find these values, we must use the derivative of (8)， 
Which is 


/ 站 2 ， 了 fk 十 1 2 

kx) 一 有 有 (x+1  X) 十 7 ( 药 ) 

G) 其。 7kjptk 上 tl PKHIA 
有 0 由 的 


Evaluating (9) at xk and Simplifying the result yield 


(410) Stk(zb) 一 即 居 一 十 砍 ， where 人 友 一 站 多 
天 


Similarly, we can replace 上 by 大 1 in (9) to get the expression for S4 1(xz) and 
evaluate it at xx to obtain 


1 1 
6 


Now use property IV and equations (10) and (11) to obtain an important relation 
involving ak 1,725，and 1akT1: 





有 1 
(11) 8 ieo) = 村 央 1 十 大 1 十 四 二 


(12) HK UN 1 十 2(1 1 十 大 JE 十 大 KPI 一 2 


Where 上 帮 一 0( 人 下 1fork=1l2...,N 1. 


Construction of Cubic Splines 


Observe that the unknowns in (12) are the desired values {makj, and the other terms 
are constants obtained by performing simple arithmetic with the data points {(xk，7)}. 
Therefore, in reality System (12) is an Underdetermined system of NW “1 linear equa- 
tions involving N 十 1 unknowns. Hence two additional equations must be supplied. 
They are used to eliminate mo from the first equation and mw from the (W bst 
equation in System (12). The standard strategies for the end-point constraints are Sum- 
marized in Table .8. 

Consider strategy (V) in Table .8. If mo is given, then jpomo can be computed, and 
the first equation (when 大 一 1) of (12) is 


(13) 2(po 十 玫 )7m21 十 户 ]7122 一 UL Pozz0. 


Similarly, 让 mAN is given, then PN 17N can be comphuted, and the last equation (when 
KK 一 N bof(l2)is 


(14) PN 21N 2 十 2(PN 2 十 jN 1)N 1 一 UN 1 PN 17N， 
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Table $S.8 ”End-point Constraints for a Cubic Spline 


Description of the Sttategy 

人 “Ciamped cupic SPpiine: spec- 
ify SCxo), SO) 
(the“best choice” ithe 
derivatives are knowD) 


(iD Nardral cupbic SPiine 
(arelaxed curve” 

(ii) Extrapolate SCx) to the 
endpoints 


(iv) Sr) is constant near the 
endpoints 

(v)  Specify SCXK) at each 
endpoint 


Equations (13) and (14) with (12) used for KK 三 2, 3,，..，N 
equations invoiving the coefficients jz1, 7122，. ， 


Equations involving 六 0 and ma N 


3 
mo 一 元 co sco) 子 


3 1 
mhN 一 -一 -CS dy 一 
PN 1 2 





mm0 三 0,mN 一 0 


hoCz2 711) 
站 1 ” 
AN 1CN 1 


HiN 2) 
IN 三 miN 1 十 1 7 


1z0 二 ml,mN 一 mAN 1 


1a0 一 S/ (xzo),mN = SCxN) 


2formN 1lnear 


.111N 1 


Regardless of the particular strategy chosen in Table $.8，we can rewrite equa- 


tions 1 and N 


1 in (12) and obtain a tridiagonal linear System of the form 万 AM = 了， 


Which involves mi, 1z2，...，7N 1: 
bi cl 1i1 1 
al 2p2 cc2 112 72 
(15) : 一 : 
GaN 3 ppN2 CN 2||mnN2 UN 2 
aN 2 pw 1|1mnwl UN 1 


The linear system in (15) is strictly diagonally dominant and has a unique solu- 
tion (See Chapter 3 for details), After the coefcients {zr] are determined, the spline 
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coefficients {S, 门 for Sr(z) are computed using the formulas 


PK (2712K 十 MK 十 1) 


Ss 0 一 次， sf 1 一 坎 5 ， 
419) 11K JI1 JIK 

5 7 一 一 一 中 ,3 一 一 一 一 一 一 . 

4 二 了 .3 6 


Each cubic polynomial Sk (xz) can be written in nested mujtiplication form for effi- 
cient computation: 


(17) EX) 一 〈(553 女 十 52) 功 十 中 1 四 十 次， Where 也 王 贡 承 


and Sr) is used on the interval 大 苹 X 荆 XIKT1. 

Equations (12) together with a strategy from Table 5.8 can be used to construct a 
cubic spline with distinctive properties at the end points. Specifically, the values for mo 
andmN in Table 5.8 are used to customize the first and last equations in (12) and form 
the system of N “1 equations given in (13). Then the tridiagonajl system is solved for 
the remaining coefficients ml , Pu， ...,MN 1. Finaly,the formulas in (16) are usedto 
determine the spPline coef 欠 cients. For Teference, we now state how the equations must 
be Prepared for each different type of spline. 


Endq-point Constraints 


The following five lemmas show the form of the tridiagonal linear system that must be 
solved for each of the different endpoint constraints in Table 4.8. 


Lemma S.1 (Clamped Spline)j. There exists a_ unique cubic spline with the first 
derivative boundary conditions S (ea) = do and SCD) = dy， 


Proof Solve the linear system 
3 
( 治 +2]m 十 Pi 一 zk 3(d0 SCxo)) 
PE 1 1 十 208K 1 十 产 C10K 十 严 ENK 二 1 一 不 for 一 2,3...，N 2 


3 . 
AN 20N 2 十 (2FN 2 十 本 pw 1D)N 1 一 UN 1 3(S Crw) dan 1 e 


Remark, The clamped spline involves slope at the ends. This spline can be visualized 
as the curve obtained when a flexible elastic rod is forced to pass through the data 
points, and the rod is clamped at each end with a fixed sljope，This spline would be 
useful to a draftsman for drawing a smooth cutrve through Several points， 


Lemma S.2 (Natural Spline)。 There exists a unique cubic spline with the free 
boundary conditions 9 (a) = 0 and S“(D) = 0. 
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Prooj Solve the linear System 


2(P0 十 严 1)721 十 瑚 122 一 2 
Pr 10 1 十 2(1K 1 十 瑚 EN 十 瑚 EPE 一 必 ， for 一 2 3 ...， NM 2. 
pw 21N 2 十 2(N 2 十 PN 1)N 1 一 LN 1. 7 e 


Rermark，The natural spline is the curve obtained by forcing a flexible elastic rod 
through the data points, but letting the Slope at the ends be free to equilibrate to the 
Position that minimizes the oscillatory behavior of the curve. It is useful for fitting a 
curve to experimental data that are Significant to several significant digits. 


Lemma S.3 (Extrapoljated Spline). There exists a unique cubic spline that uses 
extrapolation from the interior nodes at xl and x2 to determine 9“(a) and extrapojlation 
from the nodes at xN 1 andxN 2 to determine S7(D). 


Proof Solve the linear system 


也 
310 十 211 十 二 1 十 【Pi 一 102 一 2 
屎 1 天 1 


取 1785 1 十 2( 了 1 十 下)02K 十 瑚 ET 一 2 for 一 2,3,...， AN 2 


hy jw 1 
APN 2 -一 一 |mN 2+12pN 2 十 31N 1 二 一 mmN 1 一 ZN 1. @ 
PN 2 AN 2 


RemarKk. The extrapolated spline is equivalent to assuming that the end cubic is an 
extension of the adjacent cubic; that is, the spline forms a single cubic curve over the 
interval [xo, x2] and another single cubic over the interval [xN 2,xN]. 


Lemma S.4 (Parabolically Terminated Spbline)。 There exists aunique cubic spline 
that uses $7"(x) 三 0 onthe interval [xo, zl] and 9"(x) 三 0on [xN 1,XN]. 


Proof Solvethe linear System 
(3jno 十 211)mal 十 及 1712 一 1 


不 10K 1 十 2(1 1 十 Ar)AK 十 AT 一 必 for 三 2 3 .AN 2 
PN 21N 2 十 (27N 2 十 3pN 1)mN 1 一 MKN 1. e 


Rermark, The assumption that 94”“(x) 三 0 on the interval [xo, xl1] forces the cubic to 
degenerate to a quadratic over [xzo, xz1], and a similar Situation occurs over [xN 1,XN]. 
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Lemma S.5S (End-point Curyature-adjusted Spline)， There exists a unique cubic 
spline with the second derivative boundary conditions $"(a) and $S7(b) specified. 


Proof Solve the linear System 


2(pno 十 ja)1zl 十 ji712 一 41 jp0S (xo) 
pk 1 1 十 2(1 1 十 失 )AKE 十 AI 一 区 for 王 2 3 ..N 2 
AhN 21N 2 十 2(PpN 2 十 PN UDPN 1 一 UN 1 PN 1S (CrN)， e 


Rermark. Imposing values for %“(a) and $S“(p) permits the practitioner to adjust the 
curvature at each endpoint. 

The next fve examples iustrate the behavior of the various splines. it is possible 
to mix the end conditions to obtain an even wider variety of possibilities, but we leave 
these variations to the reader to investigate. 


了 Example S.7。 Find the clamped cubic spline that passes through (0, 0), (1, 0.5), (2, 2.0)， 
and (3, 1.$) with the first derivative boundary conditions 8 (0) = 0.2 and 8 (3) 一 1. 
First compute the quantities 

jo0 一 Al 三 jp2 一 1] 

d=( yo0)/po= (0 0.0)/1= 0.5 

由 =(O2 JJ)/P=(20 0.5)/1= 1.5 

中 =(03 ZJM1p=(L5 20/1= 0.5 

UL 一 6di 如 ) 一 6(1$ 0.9 一 60 

x2 一 6(d2 页 )=6( 0.5 1.5) = 12.0. 


Then use Lemma S.1 and obtain the equations 
3 
(G 十 ?) 1 十 1 二 06.0 3(0.3 0.2) = .1， 
3 
了 1 十 人 十 3 12= 一 120 3( 10 (0.3)) 三 10.5. 


When these equations are Simplified and put in matrix notation, we have 


3.3 10|1mi 5.1 
10 3.5|1m2| “1 10.5| 
Itis a straightforward task to compute the solution ml = 2.2$ and ma 一 3.72. Now 


apply the equatious in (D of Table S.8 to determine the coefficients mo and 13: 


2. 
mo 一 3(0.5 0.2) 地 -~ 0.36， 


.72 
由 一 3(0 1.0 十 0.5) 一 = 036. 
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了 》 
2.0 2.0 
1.S 1.S 
1.0 1.0 
0.5 0.5 
郑 大 
05 10 1 20 25 3.0 0 10 15 20 2 3.0 
Figure S$.12 The clamped cubic Jigure S$.13 The natural cubic spline 
spline with derivative boundary condi- with S"(0) = 0 and %"(3)] = 0. 


tions: $(0) = 0.2 and SG3) 一 1. 


Next, the values mo = ”0.36, nl 一 2.2$, 1i2 一 ”3.72, and ma 三 0.36 are substituted 
into the equations (16) to find the spline coeff6cients. The solution is 
SC) = 0.48xz3 0.18x2 二 0.2x for 0<x <1， 
SI = 104xx 1D3 上 +126(G  ]) 
(18) 十 1.28(x 1 十 0.5 for 1<x<2， 
So) 一 0.68G 2 186C 2 
十 0.68(x 72) 十 2.0 for2<x<3. 


This clamped cubic spline is shown in Figure 3.12， 


Exampjle S.8， Find the natural cubic spline that passes through (0, 0.0), (上 1, 0.5), (2, 2.0)， 
and (3, 1.5) with the free boundary conditions (xz) = 0 and S”(3) = 0. 


Use the same values { 由 ]，{( 故 ]，and {ej that were computed in Example 9.7. Then 
use Lemma $.2 and obtain the equations 


2(1 十 1])mmil 十 mm2 一 6.0， 
11 十 2(1 十 1)2 一 12.0. 


The matrix form of this linear System is 


= | 


It is easy to fnd the solution ml = 2.4 and m2 = 3.6，Since mo= S (0) = 0 and 
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113 一 9/(3) = 0, when equations (16) are used to find the spline coefficients, the result is 


SoCr) 一 0.4x3 二 0.1x for 0 <x<1， 
SO=- (人 1D3+1L2C DT? 
(19) 上 +1.3(x 1) 十 0.5 for 1<x<2， 
SO 一 006 23 18 2 
+0.7CG 2) 十 2.0 for 2 <x<3. 
This natural cubic spline is shown in Figure S.13， 国 


Example S$.9. Find the extrapolated cubic spline through (0, 0.0), (1, 0.5), (2, 2.0), and 
(3, 1.5)， 

Use the values {A]， { 愉 jand {o}) from Example .7 with Lemma S$.3 and obtain the 
linear System 


(3 十 2 十 1)mi+(l 1)wa2 一 6.0， 
(1 Jil 二 (2 十 3 十 Hz2 一 12.0， 


6.0 0.0| 由 mi 6.0 

0.0 6.0||lm2| | 12.0| 
and it is trivial to obtain mt = 1.0 and m2 = 2.0. Now apply the equations in (ii) of 
Table $.8 to compute ro and 713: 


The matrix form is 


110 一 1.0 (20 1.0)=4.0， 
13 一 2.0+( 20 10)= 53.0. 


Einally, the values for (Pakj are Substituted in equations (16) to find the spline coefficients. 
The solution is 


So00) = 0.5c 十 2.0x2 xx for 0<x<1， 
SO0)= 0 03+05G DT? 
(20) +1.5x 1D 七 0.5 for 1<x<2， 
SCx)= 05 23 人 2)? 
十 (KK 2) 十 2.0 for 2 <Y<3. 
The extrapolated cubic spline is shown in Figure S.14. 本 


Example S.10. Find the parabolically terminated cubic spline through (0, 0.0), (1, 0.5)， 
(2,2.0), and (3, 1.5). 
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1 .0 
0.5 


Figure 5.14 The extrapolated cu- 


省 
45 10 15 20 25 30 bicspline， 


Use {pk] fd, and fk from Example S.7 and then apply Lemma 3$.4 to obtain 


(十 2)711 十 2 二 6.0， 
1 十 (2 十 3)m2 = 12.0. 


5.0 1.0][m] 「 60 
1.0 S.0|11m2 | 一 12.0|， 
and the solution is mm1; = 1.7$ and mm2 一 2.75. Since Srx) 三 0 on the subinterval at 


each end, formulas (iv) in Table $.8 imply that we have mo0 三 由 1 一 1.75, and mi3 一 112 三 
2.7S$. Then the values for {mak] are substituted in equations (16) to get the solution 


The matrix form is 


S0(x) = 0.875x2 0.375Sx for 0<x <1， 
on Si 一 0.75(0 13 十 0.875Cc 1? 
十 1.375(x 1D 二 0.5 for 1<xy<2， 
SCx) = 1.375(C 2)2 十 0.87$(r 2)+20 for2<x<3. 
This parabolically terminated cubic spline js shown in Pigure 3.13. 国 


了 上 xampie S.11. Find the curvature-adjusted cubic spline through (0, 0.0)，(1, 0.3)， 
(2, 2.0), and (3, 1.5$) with the second derivative boundary conditions S"(0) = 0.3 and 
SG) = 3.3. 
Use {A, {dj and {ok] from Example $.7 and then apply Lemma 5.5 to obtain 
2(1 十 1)m1li 二 mm2 一 60 ( 0.3) 一 6.3， 
1pl 十 2(1 十 1])m2 一 12.0 (3.3) = 15S.3. 


[人 = 


The matrix form is 
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> 
2.0 
1.S 
1.0 
0.5 
蔗 Figure $.1S ”The parabolically 
05 10 153 20 25 30 terminated cubic spline. 
了 
2.0 
1.S 
1.0 
0.5 
Figure S$.16 The curvature ad- 
xx justed cubic spline with S7"(0) 一 
0 10 15 20 25 3.0 0.3 and 8"(3) = 3.3. 
and the solution is ml = 2.7 and m2 一” 4.3. The given boundary conditions are used 
to determine mo 一 S (0) = 0.3 and ma3 三 % (3) = 3.3，Substitution of {zmk 也 
equations (10) produces the solution 
So(z) = 0.Sx3 0.1Sx2 十 0.1Sx for 0<x<1， 
SO 一 12 13+1.35G 1? 
(22) 十 1.35$(x 1) 十 0.5 for 1<x<2， 
St =130 2)3 225(0x 2)? 
十 0.45$ 2) 十 2.0 for 2<x<3. 
This curvature-adjusted cubic spline is shown in Figure 5.16. 国 


Suitability of Cubic Splines 


A practical feature of splines is the minimum of the oscillatory behavior that they 
possess. Consequently, among all functions 丰 (x) that are twice continuously differen- 
tiable on [a, b] and interpolate a given set of data points {(xk， y0Dj 信 0， the cubic spline 
has less wigsgle. The next result explains this phenomenon. 
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Theorem 5$.4 (Minimum Property of Cubic Splines).， Assume that 矿 e C2[a,D] 
and SCr) is the unique cubic spline interpolant for 太 (x) that passes through the points 


{Cxc 和 GD))] 人 0 and satisfies the clamped end conditions $'(a) = 六 (oa) and Sb) = 
(DThen 


记 忆 
03) | (SCD)2dx < |/ CF"Goo)2dx. 
Proof Use integration by parts and the end conditions to obtain 
记 
1 So0Go0 SCD)ax 
一 坊 忆 
一 S (xz)C Ce) SCo0)| 1 SCx)(CD) SC))dx 
记 
=0 0 1 S OOCP xz) SCc))dx. 
人 
Since S$”“(x) = 6sk.3 on the subinterval [xx xzk+i, it follows that 
1 A71 / / 7 一 大 +1 
/YU we)dx=oaU SGD) = 
大 ， 却 一 其 
for =0.1...,N 1 Hence 记 SOC SCoO)dxz = 0,anditfollows that 
上 人 
(24) 1 SG) PC) dx 一 1 (S7(0c))2 dx. 
人 7 
Since 0 < (PCx) So0) 2 we get the integral relationship 


已 
0 < 1/ (PC So) dx 
(25) 2 


已 九 尼 
一 1 (PCOc)2dxz 2 PCr)S xz) dx 十 1 (S2(0x))2dx. 


Now the result in (24) is substituted into (25) and the result is 


忆 刁 
0< 1 (PCoD)2dx | (SoD)2dx. 


This is easily rewritten to obtain the relation (23) and the result is proved. e@ 


The following program constructs a clamped cubic spline interpolant for the data 
points {(Oxk， YA The coefficients, in descending order of Sr(x)，forK 一 0，1， 
.AN Larefoundinthe( 上 lstrowofthe output matrix $. In the exercises the 
reader will be asked to modify the program for the other end-point constraints listed in 
Table 5.8 and described in Lemmas $.2 through 5.5. 
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Prograim S.3 (Cliamped Cubic Spliine)，To construct and evaluate a clamped cubpic 


spline interpolant S(x) forthe N 十 1 data points {(xk， yb 人 0， 





function S=csfit(X,Y,dqx0 ,dxn) 


YInput -~ Xis the 1xn abscissa Vector 

冰 -~ Yis the 1xXn ordinate Vector 

名 - dx0 = 8，(x0) first derivative boundary condition 
东 - dm = $，(xn) first derivatiVve boundary condition 
YXDutput -~ 8: rowg of 8 are the coefficients，in descending 
人 ordqer ，for the cubic interpolants 

N=1ength(X)-1; 

H=diff(X) ; 

D=diff(Y) ./H; 

A=H(2:N-1) ; 

B=2*(HC1:N-1)+HC2:N7D) i; 

C=H(2:N) ; 


U=6*xdiff(D) ; 


YXClamped spline endpoint constraints 
BC1)=B(1)7-HC1)V2; 
U(CL)=U(C1)-3*(DC1)-dx0) ; 
BCN-1)=B(N-t)-HONDV2; 
UN-1)=UCN-1)-3*(dxzn-D(ON) ) ; 


for Kk=2:N-1i 
temp=A(k-1)VB(k-1) ; 
B(k)=B(k)-tempxC(K-1) ; 
U(k)=U(k)-temp*xU(k-1) ; 
end 


MGCN)=UCN-1)7VBCN-1) ; 


for k=N-2:-1:1 
M(k+lT)=(U(k)-CGK)*M(K+2))VB(k) ; 
end 


M(CL)=3kx(D(1)-dx0)VHCL)-MC2772; 
MCN+1)=3x (dxna-D(CN))VHCN)-MCN272; 


for k=0:N-1 
S(k+l1,1)=(M(k+2)-M(Ck+1))/(C6+HCk+1) ) ; 
3S(k+l ,2)=M(k+1)V/2; 
S(k+1,3)=D(k+1l)-HCk+1)*(2*M(kK+1)+M(K+2))7V6; 
S(k+1,4)=Y(CK+1) ; 

enaQ 


-一 一 一 一 一 一 一 一 一 一 一 
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Example S.12， Find the clamped cubic spline that passes through (0, 0.0)，(1, 0.5)， 
(2,2.0),and (3, 1.5) with the first derivative boundary conditions S (0) = 0.2 and $ (3) = 
1. 
In MAILAB: 


>>X=[0123];Y=[00.5 2.0 1.5] ;qx0=0.2; dxn=-1l; 
>>S=csfit(X,Y,dx0 ,dxny) 
S = 
0.4800 -0.1800 0.2000 0 
-1.0400 1.2600 1.2800 0.5000 
0.6800 ~1.8600 0.6800 2.0000 


Notice that the rows of S are precisely the coefficients of the cubic spline interpolants in 
equation (18) in Example 35.7. The following commands show how to plot the cubic spline 
interpolant using the polyval command. The resulting graph is the satme as Figure .12. 
>>xl=0:.01:1; yt=polyval(S(1,:) ,xl-X(C1)); 
>>Xx2=1: .01:2; y2=polyval(S(2,:) ,x2-X(2)) ; 
>>x3=2: .01:3; yY3=polyval(S(3,:) ,x3-X(3) ) ; 
>>pP1lot(xl,yl,x2,y2,x3,y3,XY,， .2) 四 


了 Exercises for Interpolation by Spline Functions 





1，Consider the polynomial S(x) = ao 十 alx 十 c2x2 十 a3X3. 
(a) Showthat the conditions S(1 = 1 () = 0,S(C2) = 2,and9' (2) =0produce 
the System of equations 


40 十 4 十 da2 十 6 一]1 
4 十 2a2z 十 3a3 一 0 
0 十 2al 十 4a2 十 8a3 一 2 
al 十 4a2z 十 12a3 王 0 


(bj Solve the system in part (a) and graph the resulting cubic polynomial. 
2.。Consider the polynomial S(x) = ao 十 alz 十 aa2xz2 十 373. 


(a) Show that the conditions S(1) = 3, S() = 4 SC2) = 1, and 8 2) 一 2 
produce the system of equations 


ao 十 al 十 az 十 03= 3 
4 十 202 十 3da3 一 4 
co 十 2al 十 4az 十 8as 王 1 
aa 十 4a2z 十 12a3 = 2 


(人 b) Solve the System in part (a) and graph the resulting cubic polynomial. 
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3.。 Determine whbich of the following functions are cubic splines. 丽 ipt Which, if any, of 
the five parts of Definition $.1 does a given function A(x) not satisfy? 


) ) 科 屯 x 十 15x2 旺 x3 for1<x<2 
3 人 {(X) 一 
7 - 巡 十 守 # 21x2 十 是 x3 for2<xz<3 
11 24xz 十 18x2 4x3 for1<x<2 
(pb) jx) 三 
7 S4 十 72x 30x2 十 4x3 for2<x<3 
18 有 zx 二 26x2 县 x3 forl<x<2 
(9 7G0 = 189 2 4141 3 
70 十 沪 X 40x 十 记 世 for2<xY<x3 
13 31x 十 23x2  Sx3 for1<x<2 
(9 Je) 三 ， 3 
3S$ 十 S1x 22x- 十 37 for2<x<3 


4. Find the clamped cubic spline that passes through the boints ( 3,2),( 2,0),(1,3)， 
and (4, 1) with the first derivative boundary conditions S( 3) = 1 and S (4) = 1. 


S. Find the natural cubic spline that passes through the points ( 3,2),( 2,0),， (1 3)， 
and (4, 1) with the free boundary conditions 9"( 3) = 0 and 3S7(4) = 0. 


6. Find the extrapolated cubic spline that passes through the points ( 3,.2),，( 2,0)， 
(1 3), and (4,1). 


7. Find the parabolically terminated cubic spline that passes through the points ( 3, 2)， 
( 2,0), (1 3), and (4, 1). 


8. Find the curvature-adjusted cubic spline that passes through the points ( 3,2)， 

( 2,0), (1,.3), and (4, 1) with the second derivative boundary conditions S/( 3) 一 

1 and $" (4) = 2. 

9. (a) Find the clamped cubic spline that passes through the points {(xk, 了 CD) 0， 
on the graph of /(x) 一 工 十 2 ， using the nodes x0 一 1/2,xl = 1,x2 一 3/2， 
and x3 一 2. Use the first derivative boundary conditions S (xzo) = Co) and 
S Ga3) = 太 C3). Graph 矿 andthe clamped cubic spline interpolant on the same 
coordinate Systemn. 

(pb) Find the natural cubic spline that passes through the points {(xk， 太 (CD _0， On 
the graph of /xx) = > 十 ， using the nodes xo = 1/2,X1 三 1 一 3/2,and 
2X3 三 2、Use the free boundary conditions $"(xo) = 0 and SCx3) = 0. Graph 
了 and the natural cubic spline interpolant on the same coordinate System. 

10. (a) Find the clamped cubic spline 由 at passes through the points {(xk, 让 Ge) 0， 
on the graph of (xz) = cos(x2)，using the nodes xo = 0,xl = VT7I,x2 一 
V3 了 /2 andxz3 = VS/2. Usethe first derivativeboundary conditions S'(xo) 一 
六 Go) and S (xz3) = 广 (xz3). Graph 广 and the clamped cubic spline interpolant 
on the Same coordinate System， 

() Find the natural cubic spline that passes through the points {(xzk, 太 (xb -0， 
on the graph of F(x) = cos(x2), using the nodes xo = 0,xl = VTF71I,x2 一 
V37/2. and x3 = VSTr/2.， Use the free boundary conditions S" (0xo) = 0 and 
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S"(x3) 一 0 Graph 三 and the natural cubic spline interpolant on the Same 
coordinate System. 
EL、Use the substitutions 
XkA+L YX 一 外 十 (tk 2) 
and 
GeH 和 = 有 屈 十 3 十 3 用 CO 2 十 (ge 3 
to Show that when equation (8) is expanded into powers of (xf xx), the coe 仁 cients 
are those given in equations (16). 
12。Consider each cubic function Sr(x) over the interval [xxk+1]， 

(a) Give aformulafor / 机 Sk(x) dx， 

Then evaluate 及 3 SGx)Jadx in part (a) of 

(bj) Exercise 10 (Cj) Exercise 11 

13， Show how strategy (iD in Table 5.8 and system (12) are combined to obtain the equa- 
tions in Lermma 5$.1. 
14. Show how strategy (iii) in Table $.8 and system (12) are combined to obtain the 

equation in Lemma 5.3. 

1S. (a) Using the nodes xo0 = 2 andxl = 0, show that Flxz) = x3 xisits own 
clamped cubic spline on the interval [ 2, 0]. 

(bj Using the nodes x0 = 2,xl = 0, and xz = 2, show that Flx) 一 x3 xi 
its own clamped cubic spline on the interval [ 2, 2]. Note. 矿 has an inflection 
point at xl1. 

(c) Use the results from parts (a) and (b) to show that any third-degree polynomial， 
Go) =ao 二 ar 十 a22 十 03x is its own clamped cubic spline on any closed 
interval [c , 中 . 

(gd) What if anything, can be said about the other four types of cubic splines de- 
scribed in Lemmas 3S.2 through S$.3? 

Algorithms and Programs 
1 The distance 必 that a car traveled at time 灰 is given in the folwoing table， Use 


Program 5.3 with the first derivative boundary conditions S (0) = 0 and S (8) = 98， 
and find the clamped cubic spline for the points. 


Tew 0 6 8 
Distance, dt | 0 | 40 | 160 | 300 | 480 
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2，Meodify Program 5.3 to find the (a) natural, (b) extrapolated, (ce) parabolically termi- 
nated, or (d) end-point curvature-adjusted cubic splines for a given set of points， 


3， Use your programs from Problem 2 to find the five different cubic splines for the 
points (0, D)，(1 0)，(2, 0)，(3, 1D)，(4, 2)，($, 2)，and (6, 1)，whbere (0) = 0.6， 
3 (6) = 1.8, 9 (0) = 1 and 3 (6) = 1.Plot the five cubic splines and the points 
on the Same coordinate System. 


4.， Use your programs from Problem 2 to find the five different cubic splines for the 
points (0, 0)，(1 4)，(2,8)，(3,9)，(4,.9)，(5, 8) and (6,6)，where 3/(0) = 1， 
4 (6) = 2,. 3 (0) = land (6) = 1. Plot the five cubic splines and the points 
on the Same coordinate System . 


S.The accompanying table gives the hourly temperature readings (Fahrenheib during 
a 12-hour period in a suburb of Los Angeles. Find the natural cubic spline for the 
data. Graph the natural cubic spline and the data on the Same coordinate System. Use 
the natural cubic spline and the results of part (a) of Exercise 12 to approximate the 
average temperature during the 12-hour period. 





Time, a.m. 





6. Approximate the graph of Fox) = * cos(x3) over the interval [ 3,3] using a 
clamped cubic spline. 


Fourier Series and Trigonometric Polynomials 


Scientists and engineers often study physical phenomena, such as light and sound,that 
have a periodic character They are described by functions F(x) that are periodic， 


(1) 8gG 士 忆 )=8C) for all x. 


Thbe number Pis called a period of the fonction. 
L wil suffice to consider functions that have period 2r. Ifg(x) has period 己 ,then 
jx) =8CPr/2r) will be periodic with period 2r. This is verified by the observation 


己 
(2) /e+2m0=s( 宇 + 站 =s( 乍 )= 7 
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于 -十 一 二 一 一 > 
一 2T 0 2T 4T 


Figure S.17  A continuous function 太 (x) with period 27. 


了 
7= _ 
NA o 一 一 Or 
一 一 人 一 一 十 一 二 一 全 十 一 个 一 一 人 
4= 加 0 问 


六 .. 靖 -2 下- 不 = 旋 





Figure S.18  A piecewise continuous function over fa, )]. 


Henceforth in this section we shall assume that (xz) is a function that is periodic with 
period 2r, that is， 


(3) x+27r)= xx) for al x. 


The graph 》 = fx) is obtained by repeating the portion of the graph in any interval 
of length 2r, as shown in Figure 3.17. 

Examples of functions With petriod 27 ate Sin(Jx) and cos(Jx)，where jis an 
integer，This raises the following question: Can 3a periodic function be represented 
by the sum of terms involving aj cos(Jx) and bj Sin(Jjx)2? We will soon see that the 
answWer 8 yes， 


Definition S.2 (Piecewise Continuous)， The function FGc) is said to be piecewise 
CO11H7OS On [4,D] 这 there exist values 加 , 帮 ,. 纹 Witha 王 如 < 下 < … < 
纺 一 Dsuchthat 放 (x) is continuous on each open interval 1 <x < 丰 fori 王 1,2， 
.天 ,and jxc) has leftr and right-hand limits at each of the points 二. The situation 
is illustrated in Figure 5.18. 全 
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Definition S.3 (Fourier Series). Assume that 太 (x) is periodic with period 27r and 
that jx) is piecewise continuous on [-T, ]. The Forrier series SGx) for jx) is 


oo 
人 So 一 了 十 2 j cos(jxz) 二 isin(jx))， 


where the coefficients cj and are computed with Euler's formulas: 


了 
(9) 5 = 了/ J (kx) cos(CJx)JdGx for =0，1，... 
亚 
and 
1 开 
(0) 5= 工 上 Jr)Sin(jx)dxr for 一 1，2，.... 全 
丈 


Thbe factor in the constant term ao/2 in the Fourier series (4) has been introduced 
for convenience so that ao could be obtained from the general formula (S) by setting 
/ = 0. Convergence of the Fourier series is discussed in the next Tesujlt. 


Theorem 3S.S (Fourier 了 xpansion)。 Assume that S(x) is the Fourier series for Foc) 
over [ ,六 ]. If fc) is piecewise continuous on [ 六 , 工 ] and has both a left- and 
Tight-hand derivative at each point in this interval, then S$(x) is convergent for all x < 
[ 7 ]. The relation 


SG) = 太 G) 


holds at all points xz Ee [ T,T]，whbere fx) is continuous. Ifx = ais apoint of 
discontinuity of j , then 


Ja ) 十 Far+) 


(aq) 三 7 ， 


where F(a ) and (af+) denote the left- and rightrhand limits, respectively. With this 
understanding, we obtain the Fourier expansion: 


(7) Foo = 了 十 j cos(jz) 十 by sin(jx)). 


A brief outline of the derivation of formulas (S) and (6) is given at the end of the 
Section . 
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Example S.13. Show that the function 让 (x) 一 Z/2 for 


T <X < 7T,extended periodi- 


cally by the equation (xz 十 2) = (xc), has the Fourier series representation 


SS 


Fo0=》， 


j=1 





Sin( jx) 一 Sin(x) 


Sin(2x) 十 Sin(37) 
2 3 


Using Euler's formulas and integration by parts, we get 





for 7 一 12,3,...，,and 
-三 aaax= -二 一 
for / = 1 2, 3, .... The coeffcient ao is obtained by a separate calculation: 
1 1 X2 1 





These calculations show that all the coefficients of the cosine functions are zero. The 


graph of 放 x) and the partial sumas 
92(X) 一 Sin(X) 


93(x) 一 Sin(x) 
and 


S4(x) 一 Sin(x) 


are shown in Figure 5.19. 


Sin(2x) 
2 儿 
Sin(2x) Sin(3x) 
2 一 3 


Sin(2x) 二 Sin(3x) Sin(4x) 
2 3 4 


We now state Some general properties of Fourier series，The proofs are left as 


eXxerclses. 


Theorem S.6 (Cosine Series).。 


Suppose that 丰 on) is an even function; that is, Sup- . 


pose F( x) = Jox) holds for all x. IFGx) has period 2r and 这 Fr) and 广 (x) are 
piecewise continuous, then the Fourier series for fc) involves only cosine terms: 


(8) 


where 


(9) 


JJ Cx) = 


a0 邓 
本 二 cos(7z)， 


2 邢 
x5= 了 人 (xz) cos(jx)dxr for 了 = 一 0 1，..,， 
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Figure 5$.19 The function 太 x) =X/2 over [ 并 ] andits trigono- 
metric approximation S2(xz)，S3(x) and S4(x)， 


Theorem S.] (Sine Series)， Suppose that F(x) is an odd function; that is， 广 ( 7z) 一 
(xz) holds for all x. 开 xz) has period 27 and 让 F(x) and 广 (xc) are piecewise 
continuous, then the Fourier series for 让 (zx) involves only the Sine terms: 


(10) Fo = 》 bsin(jz)， 
一 1 
WwWhbere 
(11) 与 = 革 人 rsin0ndz for 了 = 1，2，.... 
0 


Exampie S.14， Show that the function Fox) = xjlfor 六 <x < Textended periodi- 
cally by the equation F(x 十 27) 三 丰 xz), has the Fourier cosine representation 





cos((2j TD)x) 
(12) 1 5 CD 
4 
-了 (or ) 


The function jx) is an even function, so we can use Theorem S.6 and need only to 
compute the coe 人 fcients {aj: 


元 、 ，， 。 
aj 一 = XCcos(jx) dx 一 乞 smUw20) Sm) 十 2 

元 ,j 区 7 7 0 
2cos(jr) 2 2( 1D D 


for / = 1，2，3，. ... 
和 7 并 六 1 
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Since (( 1)7 11) = 0 when jis eyen, the cosine series will involve only the odd termas， 
The odd coefficients have the pattern 


4 4  ， 4 
一 -一 一 ， 人 3 一 一 一 >， 二 一 一 
4 二 区 3 ”元 32 ”元 2 


The coeffhicient ao is obtained by the separate calcujlation 


2 [7 X2 
a0 一 一 Xdadx 一 一 | 一 区 . 
亏 J0 和 10 





Therefore, we have found the desired coefficients in (12). 国 


Proof of Exiers Fornzuias jpor 7Tjeorem 3.J.、 The following heuristic argument as- 
Sumes the existence and convergence of the Fourier series representation，To deter- 
mine do, we can integrate both sides of (7) and get 


太 Joux= 太 ( +》 (ojcos(z) 十 世 ago)] GX 
区 区 j=1 


邢 ao ee 开 、 oo 。 ， 
- .3e+2 cosUDdr+ > Sin(J7X) dx 


开 产 1 开 


(13) 


一 Ta0 十 0 十 0. 


Justification for Switching the order of integration and Summation requires a detailed 
treatment of uniform convergence and can be found in advanced texts. Hence we have 
shown that 


(14) a0 一 三 Co) dx. 
丈 ,/ 


To determine am，we let mm > 0 be a fixed integer multiply both sides of (7) by 
cos(Nx), and integrate both sides to obtain 


(15) 
| (xz) cos(ax) dx 三 字 1/ COS(1NX) GX 十 》>， Cj 1/ cos(jx) cos(1ax ) dx 
元 殉 /一 1 


了 


Do 区 
十 》 三 Sin(jX) cos(MHX) dX， 
j 一 1 


Equation (15) can be simplified by using the orthogonal properties ofthe trigonometric 
fonctions，which are now stated.， The value of the first term on the right-hand side 
of (15) js 


、 
(10) 2 / cos(1X) GX 一 20Sinonz 一 0. 
2 Jr 211 区 
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Thbe value of the term involving cos(Jjxz) cos(1xz) is found by using the tmigonometric 
identity 


(17) cos(JjX) cos(NX) 一 cost(i 十 1)x) 十 cos(( 12)X)， 


When 三 关 mm,then (17) is used to get 


这 1 邢 
Ci 1/ cos(Jxz) cos(X) dx 一 ao/ CoS(( 十 i)X) dxX 
开 2 王 
(18) 1 秋 
十 2/ cogs((J 7p)xz)dx 一 0 十 0 一 0. 
开 


When /= 1 the value of the integral is 


并 
(19) Qm 1 coS(jr) cos(1IX) dx 一 am 工 . 
邢 
The value of the term on the right Side of (15) involving sin(Jx) cos(xzx) is found 
by using the trigonometric identity 


(20) sin(jx) cos(mx) 一 5 Sin((7 十 ma)xz) 十 sin((j 1)X). 


Eor all values of j and m in (20), we obtain 


已 三 Sin(Jx) cos(1X) CX 一 5 广 Sin(( 十 IJ)x)dx 
(21) 工 宛 


1 殉 
+z 1/ sin(() mp)xz)dx 王 0 上 +0=0， 
开 


Therefore, using the resujlts of (16), (18), (19), and (21) in equation (15), we conclude 
that 


区 
(22) 邢 Gor -上 |/ Cxc) cos(x) Gy， for 到 一 1，2，.2.. 
开 


Therefore，Euler's formula (5) is established.， Eulers formula (6) is proved 


similarly. e@ 


Trigonometric Polynomial Approximation 
Definition S.4 (Irigonometric Polynomial)。 A series of the form 


4 
(23) Tv(xz) = 了 十》 (ojcos(jz) 十 jsin(jz)) 
/=1 


-7 


is called a trigo1zo1ietric Dotymzomaixl of order 1M. 全 
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Theorem S.8 (Discrete Fourier Series)， Suppose that {(Cx 六 y 门 } 访 0 are 六 十 1 points， 
where yj) = (xj), and the abscissas are equally spaced: 


7 ; 
(24) xj 一 + for ) = 0，1，...，N. 
I fx) is periodic with period 2r and 2M < N, then there exists a trigonometric 


polynomial 7 (x) of the form (23) that minimizes the quantity 


AN 
(25) Cr True)?. 


大 一 1 


The coefficients aj and Dj of this polynomial are computed with the formulas 


2 忆 . 
(26) di1 = 克 亿 70eosU 吉 for ) = 0，1，...，Mf， 
and 

2 人 
(27) 5 一 六艺 7e sin(jxt) for = 1 2，...，M. 


Although formulas (26) and (27) are defined with the least-squares procedure, they 
can also be viewed as numerical approximations to the jntegrals in Eulers formulas (S) 
and (6). Eulers formulas give the coefficients for the Fourier series of a _ continuous 
function，whereas formulas (26) and (27) give the trigonometric polynomial coeffi- 
cients for curve fitting to data points. The next example uses data points generated by 
the function /zx) = x/2 at discrete points。 When more points are used, the trigono- 
Imetric polynomial coefficients get closer to the Fourier series coefficients. 


Exampjle S.1S. Use the 12 equally spaced points f 一 区 十 Kr/6,for 开 一 12....，12， 
and find the trigonometric polynomial approximation for M = S to the 12 data points 
{GCxE， CCcb))} 辽 ，， where jx) = 2Z1/2. Also compare the results when 60 and 360 points 
are Used and with the first five terms of the Fourier series expansion for (xz) that is given 
in Example 9.13. 

Since the periodic extension is assumed, at a point of discontinuity, the function value 
J (Cr) must be computed using the formula 

_ or )+Fort) 2 mh/2 


(28) Jr) 一 7 一 一 0 


The function zx) is an odd function; hence the coefGcients for the cosine termas are all 
Zero (ie, dj = 一 0forall 门 . The trigonometric polynomial of degree M = $ involves only 
the Sine terms, and when formula (27) is used with (28), we get 


75 (x) = 0.9770486 sin(x) ”0.4534498 sin(2x) 十 0.26179938 Sin(3x) 


29 
(9) 0.1511499 sin(4x) 十 0.0701489 sin(Sx)， 
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1.5 ?7= 1500 o 





Figure S.20 The tigonometric polynomial 75(x) of degree 
HM = $, based on 12 data points that lie on the line 一 X/2. 


Table $S.9 ”Comparison of Trigonometric Polynomial Coe 佳 cients for 
Approximations to (xz) =X/2 over [ 冻 , 克 ] 


Trigonometric polyaomial coeffcients 









Eourier series 
coe 仁 cients 



















0.97704862 0.99908598 0.99997462 1.0 
2D2 0.45344984 0.49817096 0.49994923 0.5 
203 0.26179939 0.33058726 0.33323S718 0.33333333 
b4 0.1S$114995 0.24633386 0.24989845 0.25 


0.07014893 0.19540972 0.19987306 0.2 


The graph of 1(z) is shown in Figure S.20. 

The coefficients of the fifth-degree trigonometric polynomial change slighty when the 
number of interpolation points increases to 60 and 360. As the number of points increases， 
they get closer to the coe 铂 cients of the Fourier Series expansion of jx).， The results are 
compared in Table 5.9. 晶 


The following program constructs matrices 4 and 妨 that contain the coefficients wj 
and pi, respectively, of the trigonometric polynaomial (23) of order M. 
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Program 5$.4 (Trigonometric Polynomials). To construct the trigonometric poly- 
nomial of order M of the form 


4 
Pr) = 了 + > (ojcos(aD 二 OsinGa) 


/一 1 


based on the N equally spaced values 允 = 式 十 27K/N,forK =1,2,...，N.The 
Construction is possible provided that 2M 十 1 < N. 





function [A,B]=tpcoeff (X,Y,M) 


%Input - X is a Vector of equally spaced abscissas in [-pi,Pi] 
攻 -~Yis a vector of ordinates 

% -~M is the degree of the trigonometIic PoLynomial 
YXOutput - A is a vector containing the coefficients of cos(jx) 
久 - B is a Vector contajining the coefficients of sin(jx) 


N=1length(X)-1; 
maxft=fix((N-1)77V27 ; 
If M>maxtL 
M=maxl ; 
end 
A=zeros(1,M+1) ; 
B=zeros(1 ,M+1) ; 
Yends=(Y(1)+Y(N+1))V2; 
Y(1)=Yends ; 
Y(CN+1)=Yends ; 
A(1)=sum(Y) ; 
for j=1:M 
A(j+1)=cos(j#X)*#Y ; 
B(j+1L)=sin(jJ*X)*Y，; 
end 
A=2x*A/N; 
B=2+B/N ; 
A(C1)=A(C1)V2; 


The following short program will evaluate the trigonometric polynomial P(x) of 
order M from Program S$.4 at a particular value of x. 
function z=tp(A,B,Xx,M) 
Z=A(t) ; 
for j= 1:M 
Z=Z+A(j+1)*Co8(j*X)+B(j+L)*Sin(jkyx) ; 
end 


一 一 一 ee _ _- 
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For example, the following sequence of commands in the MATLAB command 
window w 记 Produce a graph analogous to Figure S.20， 
>>X=-pI:.0t:PI; 
>>y=tp(A,B,XxM) ; 
>>Plot(x,7,XY，:o7:) 


了 Xercises for Fourier Series and Trigonometric Polynomials 


岂 Exercises 1 through 3$，find the Fourief Series Tepresentation of the given fonction. 
五 pt Follow the procedures outlined in Examples S$.13 and S$.14， Graph each function 
and the partial sums 92 (XK)，S3(xz)，and 5S4(x) of its Fourier series representation on the 
same coordinate System (See Figure .19)， 


1 for 并 <xfY<0 于 +x for T<xy<0 
1 一 2. 一 12 一 
7 0) 1 for0O<xY< 世 71C0) 上 X for 0<yY< 和 7 
1 for 艺 <x< 了 7 
0 ftor T<x<0 “ 
3. 一 一 4. 一 开 屯 
Co) | for 0 <yY < 区 JJCx) I for 亲 < 荆 < 子 


1 for 7<x<- 过 
T xfor 7<sx<- 赤 
S， 夏 (x) 三 天 for -这 和 <X< 了 
和 工 for 于 生 X < 下 


6. In EXxercise 1, set xy 一 克 /2 and show that 


4 3 SS 7 “ 
7. In Exercise 2, setx 一 0 and show that 
一 I++ 1 十 
8 32 SS2 72 


8，EFind the Fourier cosine series representation for the periodic function whose defini- 
tion on one periodis F (xz) = x2/4 where 站 <x < 区， 


9. Suppose that j (xz) is a periodic function with period 2P; that is,F(x 十 2P) = Je) 
ior all x. By making an appropriate substitution, show that Euler's formulas (S$) and 
(6) for 矿 are 


1 全 
j 一 三 /roee( 笃 ) dt for /=1， 2，... 


忆 / = 一 josa( 到 ) dr for 了 =1，2，.... 
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In Exercises 10 through 12， use the results of Exercise 9 to find the Fourier series Tep- 
resentation of the given function， Graph (xc)，S4(x), and 36(x) on the Same coordinate 
System 

l] for 3<x< 1 
11.， jxz) = 一 xl for 1<x<1 

1 forl<x<3 


0 for 2<x<0 
1 for0<x<2 


10. ro-| 
12. foo) 一 x+9 for 3<x<3， 


13.Prove Theorem S.6. 
14. Prove Theorem S.7. 


Algorithms and Programs 





1.、Use Program 5.4 with N 一 12 points and follow Example 5.19 to find the trigono- 
metric polynomial of degree M = $ for the equally spaced points {(xk， 广 (xb))} 也 ,， 
where FJ) is the fonction in (a) Exercise 1，(b) Exercise 2，(C) Exercise 3，and 
(d) Exercise 4. In each case, produce a graph of F(xz),，75(xz), and {(zk， 7Czt)}i， 
on the Same coordinate System， 


2. Use Program 5.4 to find the coefficients of 75(x) in Example 5.15 when first 60 and 
then 360 equally spaced points are used. 

3.。 Modify Program 5$.4 so that it will fnd the trigonometric polynomial of period 2 == 
D aa when the data points are equally Spaced over the interval fa, 5]. 

4。Use Program 5.4 to find 75(x) for (a) /xc) in Exercise 10, using 12 equally spaced 
data points, and (b) 广 (x) in Exercise 12, using 60 equally spaced data points. In each 
case, graph 75(x) and the data points on the same coordinate System. 

S. The temperature cycle (Fahrenheitb in a suburb of Los Angeles on November 8 is 
given in Table $.10. There are 24 data points， 
(a] Find the trigonometric polynomial 77(x). 
(b) Graph 厂 (x) and the 24 data points on the Same coordinate System， 
(ec) Repeat parts (a) and (b) using temperatures from your locale-. 


6.The yearly temperature cycle (Fahrenheib for Fairbanks，Alaska, is given in Ta- 
ble $.11. There are 13 equally spaced data points, which correspond to a measurement 
every 28 days. 


(aj Find the trigonometric polynomial 76(x). 
(bp) Graph 76(x) andthe 13 data points on the same coordinate System. 
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Tabie S.10 “Data for Problem 5 


[Ta 
66 









但 台 了 宁 wm 上 wii 一 
四 ARPwNB 一 


挛 王 
一 己 


Midnight 


Tabje S.11 Data for Problem 6 


Calendar date | Average degrees 








Numerical Differentiation 


Formulas for numerical derivatives are important in developing algorithms for solv- 
ing boundary value problems for ordinary differential equations and partial differen- 
tial equations (see Chapters 9 and 10)，Standard examples of numerical differenti- 
ation often use known functions So that the numerical approximation can be com- 
pared with the exact answer. For illustration, we use the Bessel function Ji (x), whose 
tabulated values can be found in standard reference books， Eight equally spaced 
points over [0, 7] are (0, 0.0000), (1, 0.4400), (2, 0.$767), (3, 0.3391), (4， 0.0660)， 





Figure 6.1 (al) The tangent to _p2(x) at (2, 0.5767) with slope PO2(2) 一 “0.0$05， 
(b) The tangent to p4(x) at (2, 0.5767) with slope p4(2) = 0.0618. 
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(3， 0.3276), (6， 0.2767), and (7， 0.004). The underlying Principle is differentia- 
tion of an interpolation polynomial. Let us focus our attention on finding .1(2). The 
interpolation polynomial pz(x) 一 ”0.0710 十 0.6982x “0.1872x2 passes through the 
three points (1, 0.4400),，(2, 0.5767), and (3, 0.3391) and is used to obtain J1(2) 入 
Po0(2) 二 0.0505. This quadratic polynomial p2(x) and its tangent line at (2, ]1 (2)) 
are Shown in Figure 6.1(a). If five interpolation points are used, abetter approximation 
can be determined. The polynomial p4(xr) = 0.4986x 十 0.011x2 0.0813x30.0116x4 
passes through (0, 0.0000)，(1 0.4400)，(2, 0.3767)，(3, 0.3391), and (4， 0.0660) 
and is used to obtain 帮 (2) 盖 p4(2) 一 0.0618. The quartic polynomial p4(xz) and its 
tangent line at (2, .JI1(C2)) are shown in Figure 6.1(b). The true value for the derivative 
js 71(2) 一 ”0.064$, and the errors in p2(x) and p4(x) are 0.0140 and “0.0026， 
Tespectively. In this chapter we develop the introductory theory needed to investigate 
the accuracy of numerical differentiation. 


Approximating The Derivative 


The Limit of the Difference Quotient 


We now turn our attention to the numerical process for approximating the derivative 


of 三 (xz): 


， fx 十 了 了 (x) 
1 Cr) = lim 一 一 -一 一 一 一 . 
吕 7 GO) 2 严 
The method seems Straightforward; choose a sequence {Pi} so that ji 一 0 and com- 
pute the limit of the sequence: 


_ je+ 则 7 


(2) 1 全 


for 有 三 1，2，...，1，..，,， 


The reader may notice that we will only compnute a finite number of terms Di D...， 
DN in the sequence (2),， and it appears that we Should use DAN for our answer，The 
following question is often posed: Why compute Di1, D2, ...，DN 1? Equivalentiy， 
we could ask: What value PN Should be chosen so that Dx is a good approximation to 
the derivative 广 (xz)? To answerthis question, we must look at an example to see why 
there ls no Simple solution. 

For example，consider the function jx) = ex and use the step sizes 户 一 1， 
1/2, and 1/4 to construct the secant lines between the points (0, 1D) and (i， 太 (有 )， 
respectively. As /gets small, the secant line approaches the tangent jine as shown in 
Figure 6.2. Although Figure 6.2 gives a good visualization of the process described 
in (1), we must make numerical computations with 万 = 0.00001 to get an acceptable 


numerical answWer, and for this value of Pthe graphs of thetangent line and secant line 
would be indistinguishable. 
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了》 = Am 








Figure 6.2 Several secant lines for 
?了 一 ex. 


Table 6.1 ”Finding the Difference Quotients 有 = (el+ 和 e)/ 反 





































大 = 7 十 Ai) 大 e 有 一 (大 e)/ 欣 

1 一 0.1 3.004166024 0.28S884196 2.8$8841960 
Pa2 =0.01 2.745601015$ 0.027319187 2.731918700 
A3 一 0.001 2.721001470 0.002719642 2.719642000 
P4=0.0001 2.718S53670 0.000271842 2.718420000 
15 王 0.00001 2.718309011 0.000027183 2.718300000 
An6=10 6 2.7182845S47 0.000002719 2.719000000 
A7=10 7 2.718282100 0.000000272 2.720000000 
Ag=10 8 2.71828185S6 0.000000028 2.800000000 
A9 王 10 9 2.718281831 0.000000003 3.000000000 

2.718281828 0.000000000 0.000000000 


Example 6.1. Let /oo) =e andx 一 1.Compute the difference quotients Dr using the 
step sizes Aik 三 10 《forK = 1,2,...,10. Carry outnine decimal Places in all calculations. 


Atable of the values FI1 十 内) and (FL 十 和 取 ) JUD)V that are used in the 
computation of Dk is shown in Table 6.1. 加 


The largest value Al = 0.1 does not produce a good approximation DPI 六 (1)， 
becausethe step size jl is too large and the difference quotient js the sljope of the secant 
line through two points that are not close enough to each other When formuja (2) is 
used with a fxed Precision of nine decimal places,， po9 produced the approximation 
Do 一 3and Rio produced Pio = 0. 开 和 Mk is too small then the computed function 
values jx 十 Mr) and (xc) are very close together The difference 让 Cx 十 7) (xc) 
can exhibit the problem of loss of significance due to the subtraction of quantities 
that are nearly equal，The value Pi0 = 10 10is so small that the stored values of 
(xx 十 Ali0) and F(x) are the same, and hence the computed difference quotient is zero. 
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In Example 6.1 the mathematical value for the limit is 广 (1) 之 2.718281828. Observe 
that the value /5 = 10 5 gives the best approximation, Ds = 2.7183. 

Example 6.1 shows that it is not easy to find numerically tbe limit in equation (2). 
The Sequence starts to converge to e, and Ds is the closest; then the terms move away 
from e，JI Program 6.1 it js suggested that terms in the sequence {Dkj should be 
computed until1DN+L DRNI>1IDN DN 1.Thisis an attemptto determine the best 
approximation before the terms start to move away from the limit When this criterion 
is applied to Example 0.1， we have 0.0007 = 1D6 Djl > Di D4 = 0.00012; 
hence Ds is the answer we choose. We now proceed to develop formulas that give a 
reasonabjle amount of accuracy for larger values of 忆 . 


The Central-difference Formaulas 


于 the function fx) can be evaluated at values that lie to the jleft and right of x, then 
the besttwo-point formula will involve abscissas that are chosen symmetrically on both 
Sides of x. 


Theorem 6.1 (Centered Formula of Order O(p2)). Assumethat F < C3[a, Dand 
thatxy 有 ,xz, 7 十 彤 Eap.Then 


JCC 二 月 7 月 


(3) Jr) 功 


Furthermore, there exists a number c = 一 CCc) e [a,p]such that 


jx 十 人 fx 用 


(4) 万 (Cr) 项 


十 玫 trunc ( 六 万)， 
Where 


17O)Cce) 


__ 2 
5 一 CO()， 


Etmnc(j 亡 ) 一 


The term 已 (六 jis caled the trrezzcation error. 


Proof Start with the second-degree Jaylor expansions Frx) 一己 (xc) 十 (O),about 
X for Fx 十 P)and Fr 万 ): 


OCR G)(cDRa3 


(S) jc 十 问 = 了 GD 十 挛 () 产 十 阿 引 


and 


JP2 FFG)(ca)13 


(9) JG 月 =7D 了 CO 一 六 3! 
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After (6) is Subtracted from (S), the result is 


(7) Jr+ 门 Je 月 =27C01+ 全 2 


Since 太 G)(x) is_ continuous,， the intermediate value theorem can be used to find a 
value c So that 


FGicD + Je) 
一 - 


This can be substituted into (7) and the terms rearrangedto yield 


(8) JG)(c). 


JeT+ 有 FG 月 ADCR 


站 
(9) 三 Go) 蒜 了 
The first term on the right Side of (9) is the central-difference formula (3), the second 
term is the truncation error, and the Proof is compjlete. ee 


Suppose that the value of the third derivative 让 3)(c) does not change too rapidly; 
then the truncation error in (4) goes to zero in the same manner as 12，which is ex- 
pressed by using the notation O(p2)、 When computer calculations are used, it is not 
desirable to choose 六 too Small，For this reason it is useful to have a formula for 
approximating 记 (x) that has a truncation error term of the order O(P4)， 


Theorem 6.2 (Centered Formuia of Order 0O (14))， Assumethat F es C5[a,b]and 
thatx 21,x PxXX 十 凡 X 十 2 ef[a,pblThen 


JGX+21) 二 8Fx+A 8 有 十 Fe 21) 
12 户 


Furthermore, there exists a number c 一 c(x) e [a, p] such that 
(11) 
三 (x) = 


(10) 太 () 六 


十 26) 十 8FGr 十 四 8 包 十 2 
人 十 Eune( 记 用， 


久 7OCo) 
30 
Proof One wayto derive formula (10) is as follows. Start with the difference between 


the fourth-degree Taylor expansions 丰 (x) = Pi(x) 十 匹 4(0x), aboutx, of Flx 十 六) and 
JJ 用): 


Eunc( 户 ) 一 一 O04). 


21900 太 2279CD 生 


(412) jx 有 Je 月 =2 太 Ce) 十 相 5 
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Then use the step size 2h, instead of PP, and write down the following approximation: 
167G)Gr)13 64FG)(cz)15 
3! 二 3! 
Next multiply the terms in equation (12) by 8 and subtract (13) from it，The terms 
involving FG)(x) will be eliminated and we get 
Fr 十 21) 十 SF 二 8 了 十 xz 21) 
(67O CD 64 太 cz)) 庆 
120 


If AGO(x) has one sign and if its magnitude does not change rapidly，we can find a 
value c that lies in [x 2A,x 十 27]sothat 


(15) 16fG(cD) 641G(cz) = 487G9(ao， 
-After (1S) is substituted into (14) and the result is solved for 疡 (xz, we obtain 


(13) JecT+T2h) Foc 27) =4 记 (zc)P 十 


(14) 
= 12 PCx) 天 十 


2 有 十 8 有 8 六 2 G(c)HR4 
6 pa _GE+2+8fG+ 月 8fG 月 + 2 ，JGG 用 
12 记 30 
The first term on the right side of (16) is the central-difference formula (10), and 
the second term is the truncation error the theorem is proved. @ 


Suppose that |fG)(c)| is bounded for ce [ea, b]; then the truncation error in (11) 
goes to zero in the same manner as /4， which is expressed with the notation OP4). 
Now we can make a comparison of the two formulas (3) and (10). Suppose that (xz) 
has five continuous derivatives and that | FG)(c| and | FS)(c)| are about the same. 
Then the truncation error for the fourth-order formaula (10) is O(p4) and wi 记 go to 
Zero faster than the truncation error O(p2) for the second-order formula (3)，This 
Permits the use of a larger step size. 


卫 xample 6.2. Let 让 (x) = cos(x)， 


(a) Use formulas (3) and (10) with step sizes 玉 = 0.1, 0.01, 0.001, and 0.0001, and cal- 
culate approximations for 六 (0.8). Carry nine decimal Places in all the calculations. 
(b) Compare with the true value F(0.8) = sin(0.8). 
(a) Using formula (3) with 瑚 = 0.01, we get 


j (0.81) /0.79) 、0.689498433 ”0.703845316 _ 
0D SS 一 0 0.717344150. 


Using formula(10) with 大王 0.01, we get 


0. . F(0. 
1Oas -加 CN 二 全 


“0.682221207 十 8(0.689498433) ”8(0.703845316) 十 0.710913538 
0.12 


太 (0.8) 


久 0.717336108. 


人 
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Table 6.2 Numerical Differentiation Using Formulas (3) and (10) 


Approximation by Error using Approximation by 
formula (3) formula (3) formula (10) 








Error using 
formuia (10) 



















。 0.716161095 0.001194996 0.7173S3703 0.000002389 
0.01 0.717344150 0.000011941 0.71735S6108 0.000000017 
0.001 0.717356000 0.000000091 0.7173S6167 0.000000076 


0.717360000 0.000003909 0.717360833 0.000004742 





(b) The error in approximation for formulas (3) and (10) turns out to be 0.000011941 and 
0.000000017, respectively. In this example, formula (10) gives a better approximation to 
(0.8) than formula (3) when 严 = 0.01. The error analysis will illuminate this example 
and show why this happened . The other calculations are summarized in Table 6.2. 国 


Error Analysis and Optimum Step Size 


An important topic in the study of numerical differentiation is the effect of the com- 
puters round-offt error， Let us examine the formulas more closely，Assume that a 
computer ls used to make numerical computations and that 


Jo 有 =》1+el and Jrxo 十 站 二 7 二 el 


whbere Foxo PP) and Foxo 十 岂 are approximated by the numerical values y》 1 and yl， 
ande 1 and el are the associated round-off errors, respectively. The following result 
indicates the complex nature of error analysis for numerical differentiation， 


Corollary 6.1(a)， Assume that /satisfies the hypotheses of Theorem 6.1 and use the 
CO1DLLEHO1CL Jprmzria 


7 人 31 >》 1 
(17) (xzo) 一 区 一. 
The error analysis is explained by the following equations: 
(18) Go) = 二 5 十 已 ( 放 月 
whbere 


达 ( 放 万) 一 Eround( 凡 思 ) 十 Eunc( 凡 用 ) 
(19) el el 记 AG(O 
四 6 ， 


whbere the oil error 1er7z 已 ( 放 加) has a part due to round-off error plus a part due to 
truncation error. 
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Coroilary 6.1(b)， Assume that 广 satisfies the hypotheses of Theorenm 6.1 and that nl- 
merical computations are made. 和 je 1| < e,|el| < eand M = maxo<r<bfl Go)|， 
then 


e MP 
(20) (及 太 )| < 志士 -让 ， 
and the value of hp tbhat minimizes the right-hand side of (19) is 
3cNL3 
- 六 二 | 一 。 
(21) (二 ) 


When jn is small, the portion of (19) involving (el  e 1)/27 can be relatively 
large. In Example 6.2, when 丑 = 0.0001, this dif 儿 culty was encountered. The round- 
Off errors are 


(0.8001) = 0.696634970 十 el Where el 祥 ”0.0000000003 
(0.7999)] = 0.696778442 十 e 1 wheree 1 0.0000000005. 


The truncation error term jl$ 


这 7 


(0.00012 (2 ) 0.000000001. 


The error term 匹 (jin (19) can now be estimated: 


0.0000000003 “0.0000000005S 
巨 ( 户 户 ) 久 一 00 0.000000001 


一”0.000004001. 


Indeed,the computed numerical approximation forthe derivative using 瑚 三 0.0001 
is found by the caliculation 


0.8) 0300D) 007229) _ 06026634270 “06026778442 
0.0002 0.0002 
= 0.717360000， 


and a loss of about four significant digits is evident, The error is ”0.000003909 and 
this is close to the predicted error， 0.000004001， 

When formula (21) is applied to Example 6.2, we can use the bound | FG)(x)| < 
|sin(OJ 中 <1= Mandthevaluee =0.5x10 9forthe Imagnitude of the round- 
off error，The optimal value for Ris easily calculated: 户 = (1.3 x 10 2/DU3 = 
0.001144714. The step Size 屎 = 0.001 was closest to the optimal value 0.001144714 
and it gave the best approximation to 广 (0.8) among the four choices involving for- 
mula (3) (see Table 0.2 and Figure 0.3). 

An error analysis of formula (10) is similar Assume that a computer ls used to 
make numerical computations and that F(xo 十 ipP) 一 次 十 ek. 
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Error bound 


4x10-6 


2 x 10-6 


Figure 6.3 Finding the optimum 
step Size 天 = 0.001144714 when 
formula (2l) is applied to Fe) = 
cos(x) in Example 6.2. 





-一 有 


0.002 0.004 


Corollary 6.2(a). Assume that jF satisfies the hypotheses of Theorem 6.2 and use the 
CO11DUIGLED1CLJDraLC 


十 8y1 8y 1+》 2 


(22) 三 Cro) 1 芒 


The error analysis is explained by the following equations: 


十 8y1 8y 1+y 


《23) 矿 (Cxo) = [其 


十 刁 ( 广 有 
Where 


五 ( 凡 六 ) 一 Eround( 太 万) 十 厂 trunc( 7 六) 
(24) e+gel 8e 1 上 +e， 147G)(c) 
127 30  ” 


Where the total error term 无 ( 记 加 has a part due to round-off error plus a part due to 
truncation error， 


Corollary 6.2(b). Assume that 矿 satisfies the hypotheses of Theorem 6.2 and that 
numerical computations are made. 于 |ek| < e and M = maxo<x<bf| GO then 


3e MHR4 
2 一 一” 
(23) | 有 (六 由 < 鞠 十 30 


and the value of 六 that minimizes the right-hand side of (2S) is 


45e\145 
(20) 闫 一 ( 守 ) ， 
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Error bound 


4x 10-7 


2 x 10-7 


0.02 0.04 0.06 


Figure 6.4 Finding the optimum step size 
产 一 0.022388475 when formula (260) is applied to 
(Cr) = cos(x) ip 了 xample 6.2. 


When formula (2$) is applied to Example 6.2, we can use the bound |FG)(x)| < 
lsin(o)1 < 工 = Mandthevaluee 二 0.3x10 ?forthe magnitude of the round- 
off error The optimal value for jn is easily calculated: 六 = (22.$ x 10 ?/4)15 一 
0.022388475. The step size 忆 = 0.01 was closest to the optimal value 0.0223884735， 
and it gave the best approximation to 广 (0.8) among the four choices invyolving for- 
mula (10) (see Table 6.2 and Figure 6.4). 

We should not end the discussion of Examplie 6.2 without mentioning that numer- 
ical differentiation formulas can be obtained by an alternative derivation，They can 
be derived by differentiation of an interpolation polynomial，For example, the La- 
grange form of the quadratic polynomial p2(xz) that passes through the three points 
(0.7, cos(0.7)), (0.8, cos(0.8)), and (0.9, cos(0.9)) ls 


P2() 一 38.2421094(x 0.8)(f 0.9) 69.6706709(f 0.7)( 0.9) 
十 31.0804984(xX 0.7)(x 0.8)， 


This polynomial can be expanded to obtain the usual form: 

pa(r) 一 1.046875165 ”0.159260044x “0.348063157x2. 
Asimilar computation can be used to obtain the quartic polynomial p4(x) that passes 
through the points (0.6, cos(0.6)), (0.7, cos(0.7)), (0.8, cos(0.8))， 《0. 9, cos(0.9)),and 
(1.0, cos(1.0)); 


P4(r) = 0.998452927 十 0.009638391x ”0.523291341z? 
十 0.026521229x3 十 0.028981100x4. 
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7 = P4C0 





和 
和 .= cosC0 


(o) (D) 


Figure 6.S (al) The graph of y = cos(x) and the interpolating polynomial pz(x) used 
to estimate 六 (0.8) 之 态 (0.8) = 0.716161095，(b) The graph of y = cos(xz) and the 
interpolating polynomial p4(x) used to estimate (0.8) 六 P4(0.8) 一 “0.717353703， 


When these polynomials are differentiated, they produce P2?(0.8) 一 0.716161095 
and p4(0.8) = 0.717353703, which agree with the values listed under 疡 一 0.1 训 
Tablie 6.2. The graphs of p2(x) and p4(x) and their ttngent lines at (0.8, cos(0.8)) are 
shown in Figure 6.S$(a) and (b), respectively. 


Richardqson's Extrapolation 


In this section we emphasize the relationship between formulas (3) and (10). Let 
有 斥 = et) = xxo 十 U)，and use the notation Do(P) and Do(2j) to denote the 
approximations to 六 (xo) that are obtained from (3) with step sizes 疡 and 2j, respec- 
fively: 


(27) 一 Jo) s Do 二 CR 
and 
(28) Go) 六 Do(26) 十 4CH2. 


开 we multiply relation (27) by 4 and subtract relation (28) from this producb then the 
terms involving C cancel and the result is 


C9) 37eo =4DoD Do = 0 关 2 

Next solve for 广 (xo) ip (29) and get 

4Do 岂 Po 有 户 +8 8 1+72 
3 127 

The last expression in (30) is the central-difference formula (10). 


(30) (xco) 





SEC. 6.1 ”APPROXIMATING THE DERIVATIVE 321 


卫 xample 6.3， Let /xc) = cos(x). Use (27) and (28) with 产 王 0.01, and show how the 
linear combination (4Do(p) Do(2p))/3im (30) can be used to obtain the approximation 
to (0.8) given in (10). Carry nine decimal places in all the calculations. 

Use (27) and (28) with 瑚 = 0.01 to get 


j (0.81) ”0.79) ”0.689498433 ”0.703845316 


0.02 0.02 
祝 0.717344150 


Do(o) 匀 


and 


jJ (0.82) (0.78) ”0.682221207 ”0.710913538 


0.04 和 0.04 
s “0.717308275. 


Po(2j) 六 


Now the linear combination in (30) is computed: 


4Do(1) Do(Cp) 4( 0.717344150) (0.717308275) 
3 3 
必 0.7173S6108. 


矿 (0.8) < 


This is exactly the same as the solution in Example 6.2 that used (10) directly to approxi- 
mate 广 (0.8). 国 


The metbod of obtaining a formula for F(xo) of higher order from a formula of 
ljower order is called extrapoiatiom. The proof requires that the error term for (3) can 
be expanded in a series containing onjy even Powers of /We have already seen how 
to use step sizes 户 and 21 to remove the term invyolving 12. To see how 14 is removed， 
let Di (P) and Di(21) denote the approximations to _ 记 (xo) of order O(p4) obtained 
with formula (16) using step sizes hand 21, respectively, Then 


户 +8 记 87 + 了 2 ， 印 7OCcD 


GD ”了 (Co) = 2 本 了 


Ai DID 十 CRP4 
and 


及 +8 户 8 2+74 1614FG)(c?) 


G2) 了 (xxo) = 1 芒 了 


DiI(2P) 十 16CP4. 
Suppose that FO) (x) has one sign and does not change too rapidly; then the assump- 
tion that G)(ci) 入 丰 G)(cz) can be used to eliminate the terms involving ji4 in (31) 
and (32), and the result is . 


10Di() DPI(C2P) 


(33) jxo) 福 本 


The general pattern for improving calculations is stated in the next result， 
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Theorem 6.3 (Richardson's Extrapolation)， Suppose that two approximations of 
order O(p2) for (xzo) are Ph 1 and Dk 1(2j) andthat they satisfy 


(34) Po) = Pr 100D 十 clREE 十 czp2kt2 十 
and 
(35) FPCxo) = Dr 1021) 十 4kci 瑚 史 十 4k+1c272k+2 十 . 


Then an improved approximation has the form 


_ 4PDr 1 Pr 1Cj 


G6) Fo) = PDT 二 OCT 本 


十 OpAH+H2)， 


The following program implements the centered formula of order O (2)，equa- 
tion (3), to approximate the derivative of a function at a given point，A sequence of 
approximations { Dj is generated, Where the centered jnterval for Prk+l is one-tenth as 
long as the centered interval for Prk. The output is a matrix L=[H，D， 忆 )],whereH 
is a Vector containing the step sizes, D is a vector containing the approximations to the 
derivative, and E is a vector containing the error bounds. Note. The function f needs 
to be input as a string; that is，: 节 . 


Program 6.1 (Differentiation Using Limits)、To approximate 广 (xz) numerically 
by generating the Sequence 


jec+l0 5 Fe 10500 1 


矿 (C0 s 一 210 雪 ) for 大王 0，...，7 


until |D +1 万 二 1D， Dr 1|or|1D， Dh，1| < tolerance, which is an attempt 
to find the best approximation 六 (xz) s ,. 





function [L,n]j=difflim(f,x,toler) 

%InPuUL 上 - 下 is the function input as a String : 开 ， 
久 - X is the differentiation point ， 

为 - toler is the tolerance for the error 
yXDutput-L=[H， D， 卫 ]: 

久 H is the vector of step SizZes 


攻 D is the Vector of apProximate derivativeg 

炙 了 is the Vector of error bounds 

炙 -0 is the coordinate of the “best approxjimationl， 
max1l=15 ; ， 

h=1; 

H(1)=h; 


D(1)=(fevalL(f ,x+h)-feval(f ,x-h))V(2*xh); 
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(1)=0; 

RCLD)=O; 

for n=1:2 
h=hVlo; 
HCn+1)=h; 
D(n+1l)=(feval(f,x+h)-feval(f,x-h))/(2+*h); 
E(n+1l)=abs(D(n+tt)-D(n)); 
RCn+1)=2*E(n+l)*(abs(D(n+1))+abs(D(n))+eps) ; 

end 

D=2 ; 


while((EGn)>E(Cn+l)) 误 (RCn)>toler) )&n<cmax1 
h=h/10; 
HCn+2)=h; 
D(n+2)=(feval(f,x+h)-feval(f,x-h))V/(2*h) ; 
ECn+2)=abs(D(n+2)-DCn+1) ) ; 
R(n+2)=2+kE(n+2)*(abs(D(n+2))+abs(D(n+1t))+eps) ; 
Dn=D+1 ; 

end 

D=Jength(D)-1; 

L=[H，D，E?] ; 


Program 6.2 implements Theorem 6.3 (Richardson's extrapolation). Note that, the 
expression for the elements in row j is algebraically equivalent to formula (36). 














Program 6.2 (Differentiation Using 卫 xtrapolation)，To approximate 广 (xz) nu- 
Imerically by generating a table of approximations D(, for < 六 and using 
jx)  Dlnm) as the final answer The approximations 刀 (), 人 are stored in a 
lower-triangular matrix. The first column is 







Fox+27 间 Fa 2 7 


D0W,0==- 5 


and the elements in row j are 






十 DPUK D DU 1 D 
44 1 


function [D,err,relerr,n]=diffext(f,x,delta,toler) 


%Input -~f is the function input as a string ? 开 ， 

儿 ~ delta is the tolerance for the erTror 

久 -~ toler is the tolerance for the relative error 
khDutput -~ D is the matrix of approximate derivatives 

从 - err is the error bound 


DPU, AND=DPOHK D 
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欠 
儿 


erTr=1， 


- relerr is the relative erTror bouna 
- D is the coordinate of the “'begst approximation7， 


TelerTr=1 ; 


h=id|; 
J=T1， 


D(t,1)=(feval(f,x+h)-feval(f,x-h))/(2*h) ; 


While relerIr>toler 廊 erT>delta &j<12 
h=h/2; 
D(j+l,1)=(feval(f ,x+h)-feval(f,x-h))/(2*h) ; 
IEor Kk=l:]j 
D(j+1,k+l)=D(j+1,k)+(D(j+l1,k)-D(j,k))/ (CC4K)-1) ; 


end 


erTr=abs(D(j+l,j+l)-D(Gj,Jj)); 
TelerT=2*err/(abs(D(j+1l,j+l))+abs(D(j,j))+eps) ; 
jj+1; 


enQ 


[mn,n]=size(D) ; 


Exercises for Approximating The Derivative 


1 Let 丰 x) = Sin(x), where x is measured in Tadians. 


(3a) 


(b) 
(c) 


Calcuiate approximations to F(0.8) using formula (3) with 万 = 0.1,7 = 0.01， 
and 瑚 一 0.001. Carry eight or nine decimal places. 


Compare with the value 广 (0.8) = cos(0.8)， 
Compute bounds for the truncation error (4). Use 


|FG)(cj| < cos(0.7) s 0.764842187 


for all cases， 


2.Let 让 (x) = ef. 


(3) 


(b) 
(c) 


Calculate approximations to _F(2.3) using formula (3) with 瑚 三 0.1, 产 = 0.01， 
and 严 一 0.001. Carry eight or nine decimal places， 

Compare with the value 六 (2.3) = e2.3. 

Compute bounds for the truncation error (4). Use 


|FGMc)| < e24 s 11.02317638 


for all cases， 
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Let jx) 一 Sin(z), where x is measured in radians. 


(a) Calculate approximations to (0.8) using formula (10) with 六 = 0.1 and 太 一 
0.01, and compare with F(0.8) 一 cos(0.8). 


(b) Use the extrapolation formula in (29) to compute the approximations to (0.8) 
in part (a)， 
(c) Compute bounds for the truncation error (11). Use 


17G)(e)| < cos(0.6) s 0.825335615 


for both cases. 


。Let 让 (x) = e-. 


(a) Calculate approximations to 广 (2.3) using formula (10) with 疡 = 0.1 andj 三 
0.01, and compare with 记 (2.3) 一 e2 3 


(b) Use the extrapolation formula in (29) to compnute the approximations to (2.3) 
jin part (a). 
(c) Compute bounds forthe truncation error (11). Use 


17G)(e| < e25 s 12.18249396 
forboth cases. 
Compare the numerical differentiation formulas (3) and (10). Let 让 (xz) = x3 and find 
approximations for 六 (2). 
(a) Use formula (3) with 大 = 0.05. 
(b) Use formula (10) wi 由 玉 三 0.05. 
(Cj “Compute bounds forthe truncation errors (4) and (11)， 


。(a) Use Taylor's theorem to show that 


JGC 二 站 = Fo) 廿 PC) 十 ， Where lc X| 一 用 ， 


有 2AO(e) 
2 
(bb Use part (a) to show that the difference quotient in equation (2) has error of 
order OO = PPFO(c)/2， 


(Cj) Why is formula (3) better to use than formula (2)? 


Partial differentiation formuilas. The partial derivative 户 (x, 7) of Foxz,y) with re- 
spect to xf is obtained by holding y fxed and differentiating with respect to x. Simij- 
larly, 户 (c, y) is found by holding x fxed and differentiating with respect to y. For- 
mula (3) can be adapted to partial derivatives 


X 十 瑚 ， 大 万， 
产 (， 7 一 到 J 帮 y) 
蒜 ， 1 区 ， 天 


(a) Let /xzx,y) = xy/G 十 站. Calculate approximations to 广 (2,3) and 万 (2,.3) 
using the formulas in (iD with 疡 = 0.1, 0.01, and 0.001，Compare with the 
values obtained by differentiating F(x, y) partially. 


十 0O(0o)， 


十 Oo2). 
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(b) Letz = (xy) = arctan(y/xr) wbhere zis in radians, Calculate approximations 
to 户 (3,4) and 记 (3, 4) using the formulas in (人 with 疡 = 0.1, 0.01, and 0.001. 
Compare with the values obtained by differentiating F(x, >) partially， 


8. Complete the details that show how (33) is obtained from equations (31) and (32). 


9. (al) Show that (21) is the value of that minimizes the right-hand side of (20). 
(b) Show that (20) is the value of 疡 that minimizes the right-hand side of (25). 
10.The voltage 达 = E() in an electrical circuit obeys the equation 无 () 一 工 (d7 /dr) 十 


民 1 (站 where Ris resistance and is inductance， Use 工 = 0.0$ and 尺 一 2 and 
values for 7(0) in the table following， 





(a) Find 7 (1.2) by numerical differentiation, and use it to compute 互 (1.2). 
(b) Compare your answer with 7 = 10e w10sin(2 站 ， 


11. The distance 刀 = DC) traveled by an object is given in the table following. 





(a) Find the velocity Y(10) by numerical differentiation. 
(b) Compare your answer with D() = 70 上 +7f 十 70e 710. 


12. Let (xx) be given by the table following. The inherent round-off error has the bound 
lek| 和 5 x 10 6. Use the rounded values in your calculations， 





Jr) = cos(Ox) 


0.45360 
0.37166 
0.36329 
0.36236 
0.36143 
0.3$302 
0.26750 
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Find approximations for 六 (1.2) using formula (17) with 户 = 0.1, 7 = 0.01， 
and 凡 一 0.001. 


Compare with F(1.2) = sin(1.2) 久 0.93204. 
Find the total error bound (19) for the three cases in part (3). 


13. Let 丰 (r) be 8iven by the table following. The inherent round-off error has the bound 
lek| < 5 x 10 6 Use therounded values 训 Your caleulations， 


(3) 


(b) 
(fc) 






Jo = In) 
1.06471 








， 1.09527 
2.999 1.09828 
3.000 1.09861 
3.001 1.09895 
3.010 1.10194 


1.13140 


Find approximations for 广 (3.0) using formula (17) with 产 三 0.1, 靖 一 0.01， 
andA = 0.001. 


Compare with 疡 (3.0) 一 和 5 0.33333. 
FEind the total error bound (19) for the three cases in part (3). 


14. Suppose that a table of the function (xx) is computed where the values are rounded 
off to three decimal places and the inherentIound-offerroris $ x 10 4. Also, assume 
that |FG(c)| < 1.5 and |AG)(c)| < 1.5， 


(3) 
(b) 


Find the best step size 刀 for formula (17)， 
Find the best Step Size 彤 for formula (22). 


1S，Let jx) be given by the table following. The inherent round-off error has the bound 
let| < 5Sx 10 6. Use the rounded values in your calculations. 


(3) 
(D) 


(xc) = cos(Gx) 





Approximate 广 (1.2) using (22) with 瑚 = 0.1 and 六 = 0.001. 
FEind the total error bound (24) for the two cases in part (a). 
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Let (xz) be given by the table following. The inherent round-off error has the bound 
lekt| < 5 xx 10 6. Use the rounded values in your calculations. 






xz) = ln(x) 
1.02962 










。 1.06471 
2.998 1.09795 
2.999 1.09828 
3.000 1.09861 
3.001 1.09895 
3.002 1.09928 
3.100 1.13140 


1.16315 


(a) Approximate F(3.0) using (22) with 疡 = 0.1 and 玉 王 0.001. 
(b) Find the total error bound (24) for the two cases in part (a). 


Algorithms and Programs 





工 . 


Use Program 6.1 to approximate the derivatives of each of the following functions 
at the given value of x， Approximations should be accurate to 13 decimal places. 
Note. [may be necessary to change the values of maxl and the initial value of h 记 
the program. 


(GD) = 60x45 32x33 十 233x5 47x2 7T;x 一 1/V3 
四 1o=m(o( 守 光 呈 )) 1+v5 


9 革 3 





1 十 X2 
(ej Go) = sin(cos(1/z)); rr 一 1V2 
(di) por) =sin(x3 7Txz2 二 6x 十 8);x 一 
(ea) =x ;=0.0001 

Modify Program 6.1 to implement the centered formula (10) of order O (4). Use this 


Program to approximate the derivatives of the fonctions given in Problem 1. Again， 
approximations Should be accurate to 13 decimal places， 


语 


1 
2 





Use Program 6.2 to approximate the derivatives of the functions given in Problem 1， 
Again，approximations should be accurate to 13 decimal places，JNote. It may be 
necessary to change the initial values of err, reLerTr, and hh， 
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Numerical Differentiation Formulas 


More Central-difference Formulas 


The formulas for . 疡 (xo) in the preceding section required that the function can be 
computed at abscissas that lie on both sides of x, and they were referred to as central- 
difference formulas, Taylor series can be used to obtain central-difference formulas for 
the higher derivatives. The popular choices are those of order O (22) and O(pn4) and are 
given in Tables 6.3 and 6.4. mn these tables we use the convention that 大 = (xzo 二 KP) 
for 大 一 3，2，1,0,1,2,3. 

For illustration, we will derive the formula for (xz) of order O(p2) in Table 6.3， 
Start with the Taylor expansions 


天 2 A 3 r(3) 4 (4) 
0 je+ 月 =JGO+ 夺 + 一 二 一 二 王 + 


Table 6.3 Central-difference Formulas of Order O(12) 





2 
ra)s 严 二 广 
3 PP Ah+211 
天 oo 一 
4 6 4 
Gaox 王 亡 十 人 1I+j 2 


Table 6.4 “Central-difference Formulas of Order OP4) 


万 +8j 8 I++ 


以 
矿 CO0) 冬 1 芒 
rn 、 己 +167 300+1671 了 
及 (xz0) 全 0 
FG)Gx0) 有 户 +8 户 13 略 +137 1 8/ 2+J 3 


813 


Joeo= 让 +I2A 39+56 帮 391 + 2 7 
6 
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and 
玫 大生 10， 到 AD 
2 0 24 


Adding equations (1) and (2) will eliminate the terms involving the odd derivatives 


PC)，FG)(x)，FG(c)，，: 


CD) je 月 = Apeo)T+ 





2 AF1 4 (4) 
一方 思 + 人 罗 二 


(3) jc 十 月 二 Je 有 =270c) 十 5 


Solving equation (3) for AP" (xz) yields 


jc 二 + 站 2870I+7e 月 21279000 
疡 2 44! 
214 F0(x) 2 克 2FC2oD(x) 
6! (21)! 


(Cr) = 
(4) 


Ithe series in (4) is truncated at the fourth derivative, there exists a value c that 
liesin[x jx 十 天] sothat 


2 7 
(5) 0xg) 一 万 六 1 太 (0 


12 


This gives us the desired formula for approximating (zx): 


2 
(6) "Cro) 六 娘 2 如 + 


Example 6.4. Let F xz) = cos(xz)， 


(a) Use formula (6) with 六 = 0.1 0.01, and 0.001 and find approximations to F"(0.8). 
Carry nine decimal places in all calculations. 
(b) Compare with the true value 六 ” (0.8) = cos(0.8). 
(a) The calculation for 严 一 0.01 is 


00.8D 27(0.80) + F0.79) 

17 入 

/1 (0.8) -0.0001 

0.689498433 ”2(0.696706709) + 0.703845316 
0.0001 

s ”0.696690000. 


(b) The error in this approximation is “0.000016709. The other calculations are summa- 
Tized in Table 6.3. The error analysis will illuminate this example and show why 疡 = 0.01 
Was best. 加 
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Tabie 6.S Numerical Approximations to 帮 (xz) for 
Example 6.4 






Error using 
formula (6) 


0.000580409 
0.000016709 
0.000706709 


Approximation by 
formula (6) 
0.696126300 


0.696690000 
0.696000000 





六 一 0.01 


Error Analysis 


Let 大 三 欢 十 ek Where ek is the error in computing Fox including noise in mea- 
Surement and round-off error Then formula (6) can be written 


2 
O) Neo = 闻 - 2 十 及 ( 太 人 


The error term 已 (PP 六 for the numerical derivative (7) will have a part due to round- 
off error and a part due to truncation error: 


el 2eo+e1l1 12fq(c) 
同人 


Hitis assumed that each error ek ls of the magnitude e, with signs that accumulate 
errofs, and that | (xz)| < M, then we getthe following error bound: 


46e MHR 
(9) IE IE 页 十 7 


If 疡 is small then the contribution 4e/ jz due to round-off error is large. When 天 
is large, the contribution Mj2/12 is large，The optimum step size will minimize the 
quantity 


4e MHz 
(10) 8(P) 三 到 十 五 


Setting 8'(p) = 0 results in 8e/13 十 MHp/6 = 0, which yields the equation 
14 = 48e/M, from which we obtain the optimal value: 


48e\L4 


When formula (11) is applied to Example 6.4, use the bound | Fox < 1 CQOS(X)| 芭 
1 一 Mandthevaluee=0.3x10 ?Theoptimalstep sizeis 盔 (24x10 2/D)L4 = 
0.01244666, and we see that 瑚 三 0.01 was closest to the optimal value. 
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Since the portion of the error due to round off is inversely proportional to the square 
of Ah, this term grows when 六 gets Small. This is Sometimes referred to as the sfep-size 
二 earaa，One partial solution to this problem ls to use a formula of higher order so 
that a larger value of 忆 will produce the desired accuracy. The formula for /j(xzo) of 
order O(p) in Table 6.4 is 


记 +16A 30J+16/1 


1/ __ 
(12) Oo) = 1 十 瑟 ( 广 站 ， 
The error term for (12) has the form 
16e ， 玉 AGO(c) 
(13) 上 (用 二 3 十 一 9 


where c lies in the interval [x 21,x 十 21]. Aboundfor| 匹 (六 有 | is 


16e “RhR4M 
14 忆 (了 了 < > 十 一 一 ， 
(14) IE(/ PS 3 十 矶 


where | /0O(xz)| < M. The optimal value for 瑚 is given by the formula 


240e\L6 


了 Example 6.S。 .Let 太 (x)] 一 cos(x)， 
(a) Use formula (12) with j = 1.0, 0.1, and 0.01 and find approximations to (0.8). 
Carry nine decimal places in all the calculations， 


(bj) Compare with the true value F”(0.8) = cos(0.8). 


(ce) Determine the optimal step size. 
(a) The calculation for 刀 三 0.1 is 


J 太 (0.8) 
、 (1.0) +16100.9) 3000.8) 十 16700.77) 7 存 0.6) 


“0.540302306 十 9.945759488 20.90120127 十 12.23747499 “0.82533S615 


0.12 
儿 0.696705958. 


(b) The error in this approximation is ”0.000000751. The other calculations are summa- 
rized in Table 6.6. 

(c) When formula(15S) is applied, we can use the bound | 和 (0) (xi < |cos(x)| 生 1= Mand 
the valuee = 0.5x10 ” These values give the optimal step size 疡 = (120x10 9/1)L56 = 
0.070231219. 国 
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Table 6.6 ”Numerical Approximations to _A"(xz) for 
Example 6.5 







Error using 
formula (12) 


0.007081296 
0.000000751 
0.000016709 


Approximation by 
formnula (12) 
0.689625413 


0.696705958 
0.696690000 










疡 三 0.1 






Table 6.7 Forward- and Backward-difference Formulas of 


Order Op 
7 310+4 站 有 己 (Ra ) 
/7 Co 和 2 difference 
/3 411+7 (Tsevard ) 
7 0 2 difference 
2j0 35A+4 户 有 户 (fand ) 
71 因 
1 oo 2 difference 
210 5 1+4A2 了 3 (sikvand 
7/ 210 > 1 二 412 JJ 3 
1 Co j2 difference 
1 
JoDs_5+I8 放 24 用 +14 有 3 
213 
5 月 18f 1+241 3 141 3+3 
JG)Go)x 过 二 2 /3 二 4 
3 用。 14 户 +26 户 24 方 +1 疡 2 
Jo) 人 
14 24 2 
Joox3 11+2f 2 2413+L4 215 


74 


Generally, 让 numerical differentiation is performed, only about half the accuracy 
of which the computer is capable is obtained. This severe loss of significant digits will 
almost always occur unless we are fortunate to find a step size that is optimal. Hence 
we must always Proceed with caution when numerical differentiation is berformed. 
The difficulties are more pronounced when working with experimental data，where 
the function values have been rounded to only a few digits. 于 a numerical derivative 
Imust be obtained from data，we Should consider curve fttinag, by Using least-squares 
techniques, and differentiate the formula for the curve. 
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Differentiation of the Lagrange Polynomial 


If the function must be evaluated at abscissas that lie on one Side of xo, the central- 
difference formulas cannot be used. Formulas for equally spaced abscissas that lie to 
the right (or left) of xo are called forward (or backward) difference formulas. These 
formulas can be derived by differentiation of the Lagrange interpolation polynomial. 
Some of the common forward- and backward-difference formulas are given in Ta- 
ble 6.7， 


也 xample 6.60， Derive the formula 
210 35 亡 +4 户 万 
天 2 


Start with the Lagrange interpolation polynomial for (0 based on the four points xo， 
X1, X2，and X3， 


Jrxo) 


辣 (XU 2) 723) 人 XU 3)G 23) 
10s> 帮 Poo + OCT GT 
人 X0)( XI 23) (人 xxXo) 人 人 xDG x2) 
十 产 本 WO xDG 十 户 间 0 CO 


Differentiate the products in the numerators twice and get 


Ps 记 22) 二 EL + 0) 直方 2C ) 十 人 2) 十 人 2 


(xx XGO xx2)(Co 23) 十 思 (1 MX) 3X2)(CC1 xxX3) 
十 2 xz0O0+(C xD 十 ( 2 4 2 xx) 二 (xD) 二 (人 2) 
(x2  Xo)(Cx2 XiC2 xxX3) ” (x3 xxXo)(0x3 xxZ1(03 22) 


Then substitution of : 一 xzo and the fact that xi  X 7 一 (人 力 Aproduces 


2(CX0 xxX) 十 (Co xz2) 十 (Co 29) 
(x0 XU 22)(x0 33) 
十 广 2(Cx0 2z) 十 (0 xx2) 十 (Co 节 力 
(1 2X0)(Cxl 32) 3293) 
2((x0 3z0) 十 (ro xD 二 (oo 历 ) 
Go2 xzo)GCc2 xl(C2  x3) 
2((Cx0 3X0) 十 (0 xD) 十 (0 2) 
(x3  Xo)(x3 xl)(x3 22) 
2(( 月 十 ( 21) 十 ( 31)) 2 十 2 站 十 ( 31)) 
( 月 ( 21( 37) (0 
2((0) 十 ( 问 十 ( 31)) 2((0) 十 ( 六 十 ( 27)) 


(xzo) 妆 万 


十 户 


十 万 


= 思 





+PP OU 十 及 0 有 
2 108 8 GPR 2 为 5 万 十 4 户 方 
= 刀 一 5 而 十 力 -33 十 轧 -7 朵 十 方 5 二 1 ， 


and the formnula is established. 
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卫 xample 6.7. Derive the formula 


3Sj+18An 24 户 +14 户 3 及 


Jrxo) 亲 砚 


start with the Lagrange interpolation polynomial for 让 () based on the five points xo0， 
X1, XY2，X3，and X4. 
FOOD 万 (人 XU xx2) 人 7X3)( 7X4) 
CO XU 和) 02)(C0 24) 
十 (人 xzo0)( 22) 人 x3)( 74) 
(1 2M0)GCIT 2)GI 1) 24) 
十 广 (xz xD 2 4) 
(xz2 Mo)(x2 TI)(C2 xx3)(x2 24) 
十 广 人 XoO TDG xx2)G 24) 
G3 2)G3 TU)(C3 2)(Cx3 24) 
十 态 (人 xX0) 人 人 TUG 22)( 23) 
(CC4  X0)(X4 xl)(C4 2)(x4 2) 
Differentiate the numerators three times, then use the substitution xi xj 一 ( 站 Rinthe 
denominators and get 





6(( XU 十 (22) 二 4 0) 十 (人 MX4)) 
( AI( 21)( 31)( 41) 
6(( 2X0) 十 (22) 十 (2 芭 ) 十 (4)) 
(CC j( 27)( 3P) 
60(( xx0) 十 (20) 十 人 09) 十 (24)) 
(21)(2)( 万 )(27) 
6(( xxo) 二 (人 22) 二 (4 22) 十 人 24)) 
(3j)(C2j)()( 及) 
6((f xo) 十 (xD 二 4 2) 二 (29)) 
(41)(3jD)(27)(P) 
Then substitution of! = xzo in the formt xz7= 一 20 3 世 一 Jproduces 


j(D 六 万 
十 万 
十 户 
十 廊 


十 为 


6(( 内 十 ( 21) 十 ( 31) 十 ( 47)) 6((0) 十 ( 21) 十 ( 31) 十 ( 41)) 
2414 十 亡 614 
6((0 天 3 及 6 4 
十 万 ((0) 十 ( 有 十 ( 4 力 + 广 ((0) 十 ( 二 )) 
6((0) 二 ( 月 +( 2 人 二 ( 31) 
24p4 ， 
60P 547 48p 427 368 
3 
5j+18 思 24 户 +14 户 3H4 
加 273 ” 
and the formula is established， 国 


Jo) 万 


十 为 
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Differentiation of the Newton Polynomial 


In this section we show the relationship between the three formulas of order O (pn2) for 
approximating 广 (xo), and a general algorithm is given for computing the numerical 
derivative,， In Section 4.3 we Saw that the Newton polynomial P(f) of degree N 一 2 
that approximates 三 (f) using the nodes 加 ,1 ,and zj is 


(16) P(OD=ao+a 加 十 0 加 )( 广 )， 
where ao = jio,al = (FU Fo) bb),and 
JP) 7 GD GD) 


妃 = 2 坟 在 加 
(2 加 ) 
The derivative of 已 (1) is 
(17) P (GD 一 al 二 az 加 ) 十 人 三)， 


and when it is evyaluated at 上 一 加 , the result is 
(18) P (to) = al 十 (0 三 ) s (0). 


Observe that the nodes { 丸 } do not need to be equally spaced for formulas (16) 
through (18) to hold. Choosing the abscissas in different orders wil produce different 
formulas for approximating 广 (x). 


Case 人: 了 一 x 二 =x 十 jandp5 一 xx 十 21,then 
jx 十 站 Fr) 
天 本 
二 Jrx) 2180 十 站 十 FFC 十 21) 
2 212 
When these values are Substituted into (18), we get 
jx 二 站 fr) jx) 二 2FxT+I 二 21 
一 一 上 + 一 一 一 一 一 一 一 . 
严 27 
This is simpliftied to obtain 


3j Cox) 十 4jC+P FAx 十 26) 
1 


PC) = 


〈19) PCz) = 


which is the Second-order forward-difference formula for 广 (x)， 
Case (让 : 入 旭 一, 刀 三 X 十 Pand 如 一 Pthen 
，  _ fC+ 有 FAGo) 
0 
JE+j 28)+JGe 月 
”212 
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When these values are substituted into (18), we get 


Pa= Je+ 朋 TD TCD+27CD We 月 


This js simpliftied to obtain 


_ C++ 月 7 


(20) Pr) 芒 


三 (f)， 
which is the second-order centralj-difference formula for 广 (x)， 
Case (iii): 玉 如 =，, 嫩 一 Pandpp 王 yx 21then 


JJ) Ar 六 

2 
站 0 2 月 二 7 2 
加 ”21 


These values are substituted into (18) and simpliftied to get 


_370D 416 月 + 21 


7 
《21) 己 (x) 芒 


广 (r)， 


which is the second-order backward-difference formula for (x). 


The Newton Polynomial P(1) of degree N that approximates (rt) using the nodes 
加 , 轴 ,，. ,1Nis 


忆 ( 人 一 G0 二 QI 加 ) 十 a2( 加) 边 ) 


(22) 
十 at 加) 人 二 )G 如) 十 :十 CN 加) 人 1. 


The derivative of P(D) is 


P'(D 一 aaz( 如 十 (人 0) 


十 03(( 10)G 0) 十 人 1 人 加 二 人 0 力 )) 
(23) N_ IN 1 


+…+aw 》， [Tc 1)- 
大 


J 2K 


When PC) is evaluated at ! = 加 , several of the termas in the summation are zero， 
and P(z) has the simpler form 


P'(o)=a 二 az 十 c3(0 6)( 2) 十 … 


(24) ， 
十 av(t 80) 5) 9) (ip iD. 
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The kth partial sum on the right side ofequation (24) is the derivative ofthe Newton 
Polynomial of degree 上 based on the first 上 nodes, If 


ti ms al<s < tl andif {c0)yo 


forms a set of N 十 1 equally spaced points on the real axis, the Kth partial sum is an 
approximation to _F(10) of order O(iK 1 

Suppose that N 一 $. IHfthe five nodes are 灰 =x 十 hforK = 0,1,2,3,and4， 
then (24) is an equivalent way to compute the forward-difference formula for JCxz) of 
order O(n4). If the five nodes { 恢 } are chosen to be 加 = 王 2 二 一 X 十 六 加 = 帮 
63 三 X 十 21,and1 一 xY 27,then(24) is the central-difference formula for (Crc) of 
order O(p4), Whenthe five nodes are 灵 =xX 人 ,then(24)isthe backward-difference 
formula for PC of order O(p4). 

The following program is an extension of Program 4.2 and can be used to imple- 
ment formula (24)，Note that the nodes do not need to be equally spaced，Also, 让 
computes the derivative at only one point 广 (x0). 








Program 6.3 (Differentiation Based on N + 1 Nodes)， To approximate 记 (x) 
numerically by constructing the Nth-degree Newton polynomial 


Po) 三 a0 十 QI xzo) 十 axoG xl) 
十 0 2X0)G XI 2) 十 十 NG xx0) Cr  xXN 1) 


and using 广 (xo) 祥 PCxo) as the final answer The method must be used at X0. 


The points can be Tearranged {zK, xz0, .KE TXE+H1 ,XN] tocompute PCxzb 
P'(xb)， 





function [A,df]=dqiffnew(X,Y) 


Input - X is the 1xn absgcissa Vector 
为 -Tis the 1xn ordjinate Vector 
%Dutput - A is the 1xn Vector containing the coefficients of 
% the Nth~degree Newton polynomial 
名 -~ df is the approximate derivative 
有 =Y ; 
N=Length(X) ; 
for j=2:N 

for KkK=N:-1:j 

A(Kk)=(A(K)-ACk-1) )/(X(CK)-X(k-j+l1)) ; 

end 
end 
XO=X(1) ; 
df=A(2) ; 


PITod=1; 
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nt=length(A)-1; 
_ 夺 or Kk=2:n1 
Prod=prod*k (x0-X(K) ) ; 
df=df+prodkA(k+1l) ; 
end 


Exercises for Numerical Differentiation Formujlas 


1， Let(x) = In(x) and carry eight or nine decimal places. 
(a) Use formula (6) with 六 = 0.05 to approximate 7"(S)， 
(b) Use formula (6) with 疡 = 0.01 to approximate 太 (S). 
(c) Use formula (12) with 户 = 0.1 to approximate (5). 
(d) Which answer (a), (bj, or (cj, is most accurate? 


2. Letf (x) = cos(xY) and carry eight or nine decimal places. 
(9 Use formula (6) with 天 = 0.05 to approximate (1). 
(Use formula (6) with = 0.01 to approximate (1. 
(ce) Use formula (12) with 疡 = 0.1 to approximate (1)， 
( 山 Which answer (a), (bj, or (cj, is most accurate? 


3. Consider the table for Fex) = ln(xz) roundedto four decimal Places. 


oo =inoo) 





(a) Use formula (6) with 产 = 0.05 to approximate (3)， 
() Use formula (6) with 六 三 0.01to approximate F"(S)， 
(ce Use formula (12) with 疡 = 0.05 to approximate (3). 
(d) Which answer, (a), (bj, or (cj, is most accurate? 


4. Consider the table for AGx) = cos(x) rounded to four decimal places. 


Go = cos() 





339 


340 


10. 


11. 


12. 


CHAP. 6 ”NUMERICAL DIFFERENTIATION 


(a) Use formula (6) with 严 王 0.05 to approximate (1). 
(bp) Use formula (6) with 大王 0.01 to approximate (1). 

(cj Use formula (12) with 关 = 0.05 to approximate (1). 
(由 Which answer (al, (bj, or (cj, is most accurate? 


、Use the numerical differentiation formula (6) and 瑚 = 0.01 to approximate 7 (1) for 


the functions 


(a) FCz) 王 2 (Fe) 王 xz4 


。Use the numerical differentiation formula (12) and 户 = 0.1 to approximate j%(1) for 


the functions 


(0 Fo) =24 (D) xz) =x6 


。 Use the Taylor expansions for /xz 十 由 ,jx jc 二 21),and Fr 2 and 


derive the central-difference formula: 


jx 二 2j) 2 +hN+2px 站 Fe 21) 


G)ruy 


、Use the Jayjlor expansions for fx 十 由 ,jx Frz 十 21),and Flx 27) and 


derive the central-difference formula: 


Co C++21 4Fcc+ 站 +6Fa) 41G 月 + 21 
和 RE 7 
，Find the approximations to AP(xk) of order O(p2) at each of the four points in the 
tables. 
人 人) 








0.989992 . 
0.999135 0.1 
0.998295 0.2 
0.987480 






0.141120 
0.041581 
0.058374 
0.157746 















Use the approximations 
天 记 思 天 万 /1 
/ 一 1 人间 / 一 人 宫 
邱 (z 十 2 and 矿 ( 】 站 


and derive the approximation 


2 
Proo 人 看 六 二 大， 


Use formulas (16) through (18) and derive a formula for (xzx) based on the abscissas 
了 和 = 三 X 1 一 X 十 jandzj 三 X 十 37. 


Use formulas (16) through (18) and derive a formula for AP(x) based on the abscissas 
如 =xY, 加 = 一 X pandp 一 yx 十 27. 
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13. The numerical solution of a certain differential equation requires an approximation to 
PC) 十 PCx) oforder O(22). 
(a) Find the central-difference formula for 六 (x) 十 PCxz) by adding the formulas 
for P(z) and (cz) of order Op2). 


(b) Find the forward-difference formula for 产 (xz) 十 P(xz) by adding the formulas 
for APG) and (cr) oforder Op2). 


(@) What would happen if a formula for P(xz) of order O(14) were added to a 
formula for F"(xz) of order O(2)? 


14，Critique the following argument， Taylor's formula can be used to get the representa- 
tions 


“四 上 7) 


Je 二 站 一 7) 二 ROOT+ 一 一 站 


and 


oo eg 


fC 月 = prFoD+ 一 一 一 5 


Adding these quantities results in 
JGCT 有 +FG 月 二 2700) 十 有 27PGo， 
which can be solved to obtain an exact formula for (co): 


jc+h 2jc)+Fx 人间 


六 Cn = 记 


Algorithms and Programs 


[ee ee | 


1.、Meodify Program 6.3 so thatit will calculate P'(xar)forM 一 1,2,...,N 十 1. 





Numerical Integration 


Numerical integration is a Primary tool used by engineers and Scientists to obtain ap- 
proximate answWers for definite integrals that cannot be solved analytically. In the area 
of statistical thermodynamics, the Debye model for calculating the heat capacity of a 
Solid involves the following function; 


族 1 
中 一 一 一 一 人. 
Cr) 人 2 


Since there is no analytic expression for 中 (x), numerical integration must be used to 
Oobtain approximate values，For example, the value 中 (S) is the area under the curve 





1 Rigure 7.1 Area under the curve 
yy 一 tf)for0<r<5. 
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Table 7.1 Values of 中 (x) 





0.2248052 












1.1763426 
3.0 2.5$22185 
4.0 3.8770542 
$.0 4.8998922 
6.0 5.3858554 
7.0 6.0031690 
8.0 6.2396238 
9.0 6.3665S739 


6.4319219 


y 一 0 王 好 /(e! DUDftor0<r<s 人 (seeFigure7.1). The numerical approximation 
for 中 (S) is 


5 3 
(5) = 上 一 一 -df 4.8998922. 
0 6 1 


Each additional value of 中 (x) must be determined by another numerical integration. 
Table 7.1 lists Several of these approximations over the interval [1, 10]. 

The purpose of this chapter is to develop the basic principles of numerical inte- 
sration. In Chapter 9, numerical integration formulas are used to derive the predictor- 
corrector methods for solving differential equations. 


JIntroduction to Quadrature 

We now approach the subject of numerical integration. The goal is to approximate the 
definite integral of F(xz)] over the interval [a, bp] by evaluating (xc) at a finite number 
of sample points. 


Defhnition 7.1. Suppose thata 一 x0<xl<… <xi 一 六 .Aformnulaofthe form 


4 
(GD CIP]= 》 wkjGzb = ofGo)+uafCcD 十 十 UHFCci) 
， 大 =0 
with the property that 


履 
O) Foodaz= o[P+EBIH] 
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is called a numerical integration or Guadreatrre formula. The term 已 [站 is called the 
17zL12Cat0O1H e1707 for integration. The values {zk] 妈 0 ate called the duULG1atfure 7iodes， 
and fbj 公 0 are called the Wezgjts. 全 


Depending on the application, the nodes {xK] are chosen in various ways. For the 
trapezoldal rule, Simpson's rule, and Boole's rule, the nodes are chosen to be equally 
spaced，For Gauss-Legendre quadrature, the nodes are chosen to be zeros of certain 
Legendre polynomials，When the integration formujla is used to develop a predictor 
formula for differential equations, all the nodes are chosen less than 0. For all applica- 
tions, it is necessary to know Something about the accuracy of the numerical solution. 


Definition 7.2. The degree of precisioz of a quadrature formula is the positive inte- 
ger 7 such that 歼 [ 玉 ] = 0 for all polynomials 户 (x) of degreei < 1, but for which 
五 [P+1] 关 0 for some polynomial 己 ,+1(xz) of degree 7 十 1 全 


The form of 互 [ 忆 ] can be anticipated by studying what happens when Fox ia 
polynomial. Consider the arbitrary polynomial 


户 00) =aicTTai IE 十 .十 ax 十 a0 


of degree i. 工 ; < mthen Po+D(z) =0foralxr,and PTD(x) 三 (1 十 Ia lfor 
al x. Thus it is not surprising that the general form for the truncation error term is 


(3) E[P]= 天 Fo+D(co)， 


Where 玉 is a suitably chosen constant and m is the degree of precision. The proof of 
this general resujlt can be found in advanced books on numerical integration. 

The derivation of quadrature formulas is sometimes based on polynomial interpo- 
lation，Recall that there exists a unique polynomial Pwr (x) of degree < M passing 
through the M 十 1 equally spaced points {(xk， 0] 好 0. When this polynomial is used 
to approximate /xc) over [a, 中 and then the integral of F(x) is approximated by the 
integral of Pa (xz), the resulting formulais called a Newton-Coles qtuadrature jporzaie 
(See Figure 7.2)，When the sample points xzo = a and xif 一 pare used, itis called a 
closed Newton-Cotes formula. The next result gives the formulas when approximating 
polynomials of degree M = 1, 2, 3, and 4 are used. 


Theorem 7.1 (Closed Newton-Cotes Quadrature Formula). Assume that xz 一 
X0 十 号 areequaliy spaced nodes and 碌 = ocx). The first four closed Newton-Cotes 
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?》 了 
1.5 1.5 
10 y=j 1.0 y=jn 
0.5 0.5 
郑 区 
0.0 0.5 1.0 1.5 2.0 0.0 0.5 1.0 1.5 2.0 
(9g) ( 
?了 了 
1.5 1.5 
1.0 = 1.0 ?了 = 
0.5 0.5 
天 并 
0.0 0.5 1.0 ]1.5 2.0 0.0 0.S 1.0 1.5 2.0 
(4o) (O) 


Figure 7.2 (a) The trapezoidal rule integrates y = PICx) over [xzo,xl] 三 [0.0, 0.5]. 
(b) Simpson”s rule integrates 》 = 已 (x) over [x0, xl] = [0.0, 1.0]. (c) Simpson's ruje 
integrates 》 = 户 (x) over [xo,xz3] = [0.0, 1.5]. (d) Boole's rule integrates y = P4x) 
over [xo,x4] = [0.0, 2.0]. 


quadrature formulas are 


(4) |/ Je) dx 入 (有 十 万) (the trapezoidal rule)， 
x0 
22 玉 
(9) 1/ JJ dx 和 了 (ja 十 4 万 十 户 ) (Simpson's rule)， 
x0 
3 35 ， ，3 
(0) COz) dx 久 于 (加 十 3 万 十 3 户 十 户 ) (Simpson's 5 rule)， 
2 
友 27 
(7) jx) dx 久 石 (加 十 32 记 十 12 户 二 32 有 户 十 7.J4) 


X0 


(Boole's rule). 


Corollary 7.1 (Newton-Cotes Precision). Assume that 让 (x) is sufficiently differen-~ 
tiable; then EL for Newton-Cotes quadrature involves an appropriate higher deriva- 
tive. The trapezoidal rule has degree of precision 关 一 1. 开 太 E C2[fa,D],then 


@ X1 了 天 有 3 a 
) Jr) xz 一 了 (如 十 放 ) 五 / (c)， 


X0 
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Simpson's rule has degree of precision = 3.If As C4[a, 5],then 


X2 瑟 55 
@g) 1/ JoDdz= (有 +4 让 + 月 二 1 
x0 


Simpson's rule has degree of precision 一 3.If ee C4[a,b],then 


53 3 3j5 
0) /yie= 召 +36+3P+ 则 而 1 
70 
Boole's rule has degree of precision 7 = $. If 太 es C6fa ,bj,then 


2 8 .9 
GD ] Fo0dz 2 妇 0 用 二 32 户 十 12 户 二 32 户 二 7 月 呈 roda， 
2x0 45 944 


Prpoof of 7Tjpeorem 7.17. Start with the Lagrange polynomial PMf(xz) based on xzo, xl1， 
-.. ,YAM that can be Used to appbroxitmnate (xz): 


MA 
(12) Jo0s Ph = 》 大 LECD， 


K 一 0 


where 太一 Foxk) forK 一 0 1 .. .MAn approximation for the integral is ob- 
tained by replacing the integrand /(x) with the polynomial Pw (xz). This is the general 
method for obtaining a Newton-Cotes integration formula: 


X1Mf 光 Mf 
|/ JJCx) dx = |/ Par(xz) GdX 
大 20 


0 


”pxX 好 好 区 
3 =- 人 (Azuuojw= 关 (人 zweoar] 
忆 K=0 K=-0 、20 


0 
4 Xif 好 
一 (/ LuxDaz 大 = 》 由 友 . 
类 一 0 0 类 =0 


The details for the general proof of (13) are tedious， We shall give a sample proof 


of Simpson's rule，which is the case M = 2. This case involves the approximating 
Polynomial 


(14) 
PC = 用 or 2)( 交 ) C_xoC 轨 ) GCC _ xo)( xD) 


X0 xl)(xzo0 蕊 十 轧机 X0)(Cx1 苛 十 ] X0)(xz2 xD 
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Since 成 . Ah and 户 are constants with respect ta integration, the relations in (13) lead 
to 


(15) 
加 52 XI 2) 2 xxX0)G 各) 
CEx 忆 一 一 -一 -一 4 一 -一 一 一 一 4 
人 7 0 hi 0] 
了 2 (KxX0OCc 2X0) 


一 -一 -一 一 dr. 
大 


We introduce the change of variable x = x0 十 Pi with dx = Pdrtoassist with 
the evaluation of the integrals in (13). The new lmits of integration are from = 0to 
1 一 2. The equal Spacing of the nodes 人 砍 一 X0 十 人 leadsto 克 2 一 (Pand 
X 区 三 mp 有 ,which are usedto simplify (1$) and get 


(0 
怒 Pd DR 2) “2pd Op 2) 
人 /oaxs 万 人 0 万 0 场 hac+ 太 人 砚 C 厅 4 
2At Op TD 
二 人 CD 何人 


下 2 2 天 2 
= 人 5 人 (人 3 十 2 二 Ar (人 20dr+ 户 2 人 (2 沁 帮 
2 J0 0 2 .0 








一 2 1 一 2 
天 (6 38 切 2 
一 j7 人 本 + 万 (5 
1 一 0 1=0 
一 2 
7a PN 
77 ( 引 
1=0 





天 
了 (yo 十 4 户 十 户 )， 


and thbe proof is complete，We postpone a sample proof of Corollary 7.1 until Sec- 
tion 7.2. e 


了 Pxample 7.1. Consider the function Fex) 一 1+e xsin(4x),the equally spaced quadra- 
ture nodes xzo = 0.0, xl = 0.$,2 = 1.0, xz3 = 1.3, and x4 三 2.0, and the correspond- 
ing function values 思 = 1.00000, 户 = 1.5$152, 户 = 0.721$9, 方 = 0.93763, and 
及 = 1.13390. Apply the various quadrature formulas (4) through (7). 
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The step size is 妃 = 0.5, and the computations are 


0.5 0 
jx)dx 匀 全 (1.00000 十 1.3$1S2) = 0.63788 


1.0 0 
oo ax (1.00000 十 4(1.55152) 十 0.72159) = 1.32128 


1.5 
JJ)dx 入 0.00000 十 3(1.55152) 十 3(0.72159) 十 0.93765) 


一 1.64193 
20 2(0.9) 
JJ) dx 忆 有 04.00000) 十 32(1.35152) 十 12(0.72159) 
0 


十 32(0.93765) + 7(1.13390)) = 2.29444. 本 


Itis important to realize that the quadrature formulas (4) through (7) applied in the 
above illustration give approximations for definite integrals over different intervals. 
The graph of the curve y = (xz) and the areas under the Lagrange polynomials y = 
Po) y 三 已 (xy 一 声 (xz),andy 一 疡 (xz) areshownin Figure 7.2(a) through (d)， 
respectively. 

In Example 7.1 we applied the quadrature rules with 尺 = 0.$. 于 the end points 

-of the interval fa, p] are held fxed, the step size must be adjusted for each rule. The 
step sizes are 庆 一 D， 4/ 一 ( ac)/21=( al)/3,andn=( aa)/4forthe 
trapezoidal rule, Simnpson's rule, Simpson's 和 rule, and Boole's rule, respectively. The 
next example jllustrates this point. 


Example 7.2.， Consider the integration of the function fxz) = 十 e xsin(4r) over the 


fxed interval [a, )] 三 [0, 1]. Apply the various formulas (4) through (7). 
For the trapezoidal rule, 下 = 1and 


1 1 
上 75O+7G) 
1 
一 本 (100000 十 0.72159) = 0.86079， 
FEor Simpson's rule, 户 = 1/2, and we get 
1 
1/2 1 
/Joe 闻 vO+4 风 +7GD) 
一 0L.00000 十 4(1.$S$1S2) 十 0.721S9) = 1.32128， 
FEor Simpson's 时 rue, 天 = 1/3, and we obtain 


1 1/3 
1/ FoDdx 人 or +3FG 思 +3FG9) 上 7OD) 


一 5(L00000 十 3(1.69642) 二 3(1.23447) 二 0.72159) = 1.31440. 
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了 
7 y= 甩 2 ?7= 所) 
1.5 1.5 
1.0 L0 
0.5 0.5 
尖 大 
00 02 04 06 08 10 00 02 04 06 08 10 
(O) (D) 
了 
”= y = 
5 1.4 
1.0 1.0 
0.5 0.5 
龙 
00 02 04 06 08 10 00 02 04 06 08 410 
(OO (g) 


Figure 7.3 (a) The trapezoidal rule used over [0, 1] yields the approximation 0.86079， 


(b) Simpson's rule used over [0, 1] yields the approximation 1.32128.(c) Simpson's 
Tule used over [0, 1] yields the approximation 1.31440. (d) Boole's rule used over [0, 1] 
yields the approximation 1.308S9. 


For Boole's rule, 妃 = 1/4, and the result js 
1 2(1714 
人 JoDdzm 二 人 OO +321 和 +127 二 +327 人 9 二 770) 


1 
一 区 (4.00000) 十 32(1.65534) + 12(1.55152) 
十 32(1.06666) 十 7(0.7215$9)) = 1.30859. 
The tmue value of the definite integral is 


1 21le 4cos(4) sin(4 

人 FnDdxz = 二 2 “co 人 sm 人 -~ 1.3082506046426.，.， 
0 t7e 

and the approximation 1.308S9 from Boole's rule is best, The area under each of the La- 


grange polynomials 户 (z), 己 (x), 声 (x), and 瑚 (xz) is shown in Figure 7.3(a) through (d)， 
respectively. 晶 


To make afair comparison of quadrature methods, we mustuse the same number of 
function evajiuations in each method. Our final example is concerned with comparing 
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integration Over 3a fxed interval [a, 站] using exactly fve function evaluations 及 = 
(xj forK = 0, 1 ..…，4foreach method，When the trapezolidal rule is applied on 
the four subintervals [xo, x1],， fx1l, xz2]，[x>, x3],， and [x3, x4j, it is called a CO71PDOSite 
1rapezoidal rrle: 


三 roa= 矿 Joax+ / Tooax+ 上 Teoax+ 1 CD ax 
2 2 光 1 7J2 X3 


瑚 瑚 下 
(17) 和 本 ( 古 六 十 可 (及 + 用 ) 十 了 ( 户 二 廊 ) 十 本 ( 方 十 有) 
忆 


一 7( 轴 十 2 有 十 2 户 十 2 户 十 月 ). 


Simpson's rule can also be used in this manner. When Simpson's rule is applied on the 
two Subintervals [xo, Y2] and [x2, x4], it is called a comzposite Sizazpso13S rate: 


全 fedz= 三 (xc dx 十 JCc) dx 
0 X0 2 


忆 
0139) (用 二 4 万 十 亡 ) 二 3 (及 二 4 户 十 月 
天 


= 了 (fo 十 4 方士 2 庆 十 4 亡 十 J)， 


The next example compares the values obtained with (17), (18), and (7). 


了 上 xample 7.3。 Consider the integration of the function fx) = 1 十 e xsin(4x) over 
[ce,b] = [0, 1]，Use exactly five fnction evaluations and compare the results from the 
composite trapezoidal rule, composite Simpson rule, and Boole's rule. 

The uniform step size is 户 = 1/4. The composite trapezoidal rule (17) produces 


1 1/4 
1 J CDarz ss 冯 dr 十 27( 和 ) 十 27( 坟 十 27(3) 十 了) 
0 
二 5G.00000 十 2(1.05534) 十 2(1.55152) + 2(1.06666) 二 0.72159) 
= 1.28358. 


Using the composite Simpson's rule (18),， we get 


1/4 
jms 字 dO+41+27 由 +4BTFOD) 


一 五 (L00000 十 4(1.65534) 十 2(1.3551S2) 十 4(1.06666) 十 0.7215S9) 
一 1.30938. 
We have already seen the result of Boole's rule in Example 7.2: 
1 2(1/4) 1 1 3 
/7ais 2 人 ofO+21 由 +D27 由 +327 罗 +770D) 
一 1.30859， 
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7=Joo 





0.00 0.25 0.30 ”0.75 1.00 0.00 0.25 0.30 ”0.75 1.00 
(O) 人 


Figure 7.4 (a) The composite trapezoidal rule yields the approximation 1.28358. 
(b) The composite Simpson rule yieids the approximation 1.30938. 


The true value of the integral is 


1 四 
1/ FooDdx = 人 二 1.3082506046426 .，.， 
0 


and the approximation 1.30938 from Simpson's rule is much better than the value 1.28358 
obtained from the trapezoidal rule. Again, the approximation 1.30859 from Boole's rule is 
closest. Graphs for the areas under the trapezoids and parabolas are shown in Figure 7.4(a) 
and (b), respectively. 国 


Example 7.4. Determine the degree of precision of Simpson's 部 rule. 
世 will suffice to apply Simpson's 和 rule over the interval [0. 3] with the five test func- 
tions (xz) = 1,x,x2,73, and x4. For the first four functions， Simpson?s Tule is eXact. 
3 3 
人 1dx 一 3 一 8Q 十 3(G) 十 3(D 二 了 1 
0 
9 3 
1 xdx 王 = 一 -=-(0 十 3() 十 3(2) 十 3) 
0 2 8 
3 3 
1 rdz=9= 0+30+3()+9 
0 
3 3 
人 8GQ+30D 十 308) 十 27)， 
0 


The function xz) 一 X4isthe lowest power ofx for which the ruje is not exact. 


81 
dx 一 一 一 
计 关 不 


3 243 9%9 3 
人 xz4dx = 一 交 一 = 二 (0+3() 十 3(16) 十 81). 
0 $ 2 8 


Therefore, the degree of precision of Simpson's 半 rule is7 三 3. 二 
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了 xercises for Introduction to Quadrature 





1.、Consider integration of F(x) over the fixed interval [a, 四 = [0, 1]. Apply the various 
duadrature formulas (4) through (7). The step sizes are 户 一 1], 疡 一 芭 严 一 耻 and 
产 一 了 for the trapezoidal rule, Simpson's rule, Simpson's rule, and Boole's rule， 
respectively. 
(a) xc) = sin(rz) 
(b) jx) 王 1 十 e cos(4xz) 
(ee) = sin(V 困 
有 RemarK. The true values of the definite integrals are (al) 2/r = 0.636619772367 . . .,， 
(b) (18e cos(4) + 4sin(4))/(17e) = 1.0074$9631397 ...，and (c) 2(sin(1) 
cos(]1)) 三 0.602337357879 .... Graphs of the functions are shown in Figures 7.5(a) 
through (c), respectively. 

2。Consider integration of 丰 (x) overthe fixed interval fa, 疏 = [0, 1]. Apply the various 
quadrature formulas: the composite trapezoidal rule (17)， the composite Simpson 
rule (18), and Boole's rule (7). Use five function evaluations at equally spaced nodes. 
The uniform step Size is 瑚 一 于 
(ce) =sin(rxz) 
(b) jx) 王 1 十 e xcos(4x) 
(C) yx) = sin(V2 

3.Consider a general interval [a, 0]， Show that Simpson's rule produces exact results 
forthe functions F(xz) 一 x2 and fx) = x3;that is， 








3 3 4 4 
训 .2 _ 六 人 六 .3 _ D 7 
(3) 如 工 dx = 可 本 (b) 几 x = 元 
4，Integrate the Lagrange interpolation polynomial 
大 2X1 XXX0 
天 0) 一 轧 十 万 
X0 XI X1 xxX0 


over the interval [x0, xl1] and establish the trapezoidal rule. 


》 》 》 
1.0 2.0 1.0 
0.5 1.0 0.5 
大 大 光 
0.0 0.5 10 ”00 0.5 10 ”0.0 0.5 1.0 
(W 岂 (c) 


Figure7.$S (a)y 一 Sin(rx), (by 三 1 二 excos(4xz)j,(c)y = Sin(vV/X)， 
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。Determine the degree of precision of the trapezoidal rule, It will sufce to apply the 


trapezoidal rule over [0, 1] with the three test functions Ax) = 1,x, and X2. 


。Determine the degree of precision of Siimnpson's rule, 了 will suffice to apply Simp- 


son"s rule over [0, 2] with the five test functions A(xz) 三 1 X2, x3, andx4.Contrast 
your result with the degree of precision of Simpson's rule. 


。Determine the degree of precision of Boole's rule. It will suffice to apply Boole's rule 


over [0, 4] with the seven test functions 让 (x) 三 1,x， 2X2.x3,x4 x5,andx6. 


。The intervals in Exercises $, 6, and 7 and Example 7.4 were Selected to simplify the 


calculation of the quadrature nodes，But，on any closed interval [a, 四 over which 
the function is integrable, each of tbe four quadrature rules (4) through (7) has the 
degree of precision determined in Exercises $, 6, and 7 and Exatmple 7.4,respectively. 
Aquadrature formula on the interval [a, pb] can be obtained ffom a guadrature formujla 
on the interval [c,d] by making a change of variables with the linear function 

C ad pc 


六 
xz 一 8 一 了 C 十 Q cc ” 








PP da 


h 一 ， 
Where dx 了 d 


C . 

(a) Verify thatx 一 8(D is the line passing through the points (c, a) and (d, 0)， 

(b)， Verify that the trapezoidal rule has the same degree of precision on the interval 
[ce, b] as on the interval [0, 1]. 

(ce) Verify that Simpson's rule has the same degree of precision on the interval [a, 5] 
as on the interval [0, 2]. 

() Verify that Boole's rule has the same degree of precision on the interval [fa,b] 
as on the interval [0, 41. 





Derive Simpson?s 和 rule using Lagrange polynomial interpolation. Hipt After chang- 
ing the variable, integrals similar to those in (16) are obtained: 


3 3 3 
1/ xz)dx 入 ha /ce 1)( 2) adi+jh3 1 0 人 2 3)dr 
X0 6 0 2 0 
瑚 3 3 
jc 0 DG 3)d+ 户 3 人 0 DC 2)dt 
0 6 .Jj0 


一 3 
pf 1 3 1 天 59 
= 帮 =- | 一 -二 26 一 -十 从 二 [一 一 2 
轧 ( 十 5 十 3 了 本 十 3 


一 3 
1 t4 43 32 瑚 (1 坟 
+ 有 亡 了 [ 林 + 本 柯 儿 +AhE (二 三 二 
，_0 0 \ 4 


4 3 2 
Derive the closed Newton-Cotes quadrature formula, based on a Lagrange approxi- 
mating polynomial of degree $, using the 6 equally spaced nodes xx 一 X0 十 大 where 
K 一 0, 1,...，9. 


1=3 














一 一 一 


35$S4 CHAP. 7 NUMERICAL INTEGRATION 


11， In the proof of Theorem 7.1, Simpson's rule was derived by integrating the second- 
degree Lagrange polynomial based on the three equally spaced nodes xo, xi, and x2. 
Derive Simpson's rule by integrating the second-degree Newton polynomial based on 
the three equally spaced nodes xo, xl, and x2， 


Composite Trapezoidal and Simpson's Rule 


An intuitive method of finding the area under the curve 》 一 jc) over [fc,D] is 
by approximating that area with a series of trapezoids that lie above the intervals 
{[xx, xkHI]]. 


Theorem 7.2 (Composite Trapezoidal Rule). Suppose that the interval [a,p] is 
subdivided into W subintervals [xxk+lof width 天 = ( ca)/Mbyusingtheequally 


spaced nodes 雁 三 QG 十 Kpfor 大 一 0,1,...，hMf.The composite tapezoidal ruie jpor 
af sxDinzterrals can be expressed in any of three equivalent ways: 


天 af 
(1a) T(/ 站 = 本 2_OCx D+GD) 
天 一 1 


OF 


忆 
(pb) 了 工人 及 一 01 十 2 轧 十 2 户 二 2 户 十 十 214 2 十 21u 1 二 Jih) 


OT 


下 M_1 
(lo) T(GA 月 = 本 TUGO+7OD)+A 2， Go， 


天 一 1 


This is an approximation to the integral of 让 (xz) over [a, D], and we write 


b 
(2) 1/ J Ce) dx s 了 (四 )， 


Proof Apply the trapezoidal rule over each subinterval [zk 1, ] (see Figure 7.6). 
Use the additive property of the integral for subintervals: 


已 4 
G) 1 JoDdr=》， 
4 天 一 1 


Since /2 is a constant, the distributive law of addition can be applied to obtain (1a). 
Formula (lb) is the expanded version of (1a). Formula (lc) shows how to group all the 
intermediate terms in (lb) that are multiplied by 2. e 


2 


好 
严 
JJGx 和 》 本 (J Gtk 1) 十 了 (Cxk)). 
天 一 1 


7 
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= 


Figure 7.06 ”Approximating the area 
X _ under the curve 》 一 2 十 sin(2Vxr) 


0 1 2 3 4 5 6 with the composite trapezoidal mule. 


Approximating fx) 一 2 上 +Sin(2x) with piecewise linear polynomials results in 
Places where the approximation is close and places where it is not, To achieve accuracy 
the composite trapezoidal rule must be applied with many subintervals，In the next 
example we have chosen to numerically integrate this function over the interval [1, 6]. 
Investigation of the integral over [0, 1] is left as an exercise. 


了 Example 7.S. Consider (xz) 一 2 + sin(2Vx). Use the composite trapezoidal rule with 
11 sample points to compnute an approximation to the integral of Fx) taken over [1, 6]. 

To generate 11 Sample points, we use M = 10 and 有 = (6 1/10 = 1/2.Using 
formula (1c), the computation is 


172 
rU = 宇 wO+HGO) 


1 
+ 5 坟 + 7C) +AG) +AG) + 7 人 二 7 二 GD)+7G)+ 7 号) 


1 
一 了.90929743 十 1.01735756) 


二 1 人. 6381S764 二 2.30807174 二 1.97931647 十 1， 68305284 十 1.43530410 
十 .24319750 十 1. 十 1.02872220 十 1. 00024140) 
一 (3.92665499) 十 014.42438165) 
= 0.98166375 十 7.21219083 = 8.1938S457. 


田 
Theorem 7.3 (Composite Simpson Rule). Suppose that [a, pb] is subdivided into 
2Af subintervals [xx, 区 +1] ofequal width 闫 = (5 /MD) by using 太 三 aa 十 以 for 
大 二 0 1,...，247. The comaposite Simzpyom rie Jpor2M SUDipzteryais can be expressed 
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in any of three equlivalent ways: 


人 

(4a) S(/ 月 一 3 > (1Cok 人 十 4fGcok D 十 Coob) 
天 一 1 

or 


屎 
(六 用 三 卫 ( 思 十 4 万 十 2 户 十 4 户 
十 … 十 2jPM 2 十 4PM 1 十 户 M) 


(4b) 


OF 


下 刀 
(4c) S(/) = 了 CO) 十 7 了) 十 


w| 时 


M_1 4 妈 
>》 ， Get) 十 本 2 ye 1). 
天 一 1 类 一 1 


This is an approximation to the integral of F(xz) over [a, 5],and we write 


， 
G) 1 Fo0dzs SF 六. 


Proof Apply Simpson's rule over each subinterval [x2k 2, xX2k] (see Figure 7.7). Use 
the additive property of the integral for subintervals: 


MPzx 


忆 人 
1 JfoDdz=> 人 JooDdz 


(0) 才 一 1v 7Z2K 2 


ad 
万 
富 》 二 (2 2) 十 4 1) 十 (ck))， 
对 3 


Since /3 is a constant，the distributive law of addition can be applied to ob- 
tain (4a)， Formula (4b) is the expanded version of (4a). Formula (4c) groups all 
the intermediate terms in (4b) that are multiplied by 2 and those that are multiplied 
by 4. e 


Approximating xz) = 2 二 sin(2VX) with piecewise quadratic polynomials pro- 
duces places where the approximation is close and places where it is not. To achieve 
accuracy the composite Simpson rule must be applied with several subintervals，I 
the next example we have chosen to numerically integrate this function over [1, 6] and 
leave investigation of the integral over [0, 1] as an exercise. 
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了 
3 
2 ?= 
1 
Figure 7.7 ”Approximating the area 
X under the curvey 一 2+sin(2/X) 
0 1 2 3 4 3 6 with the composite Simpson rule. 


Example 7.6. Consider f(x) =2 十 Sin(2Vx). Use the composite Simpson rule with 11 
Sample points to compnute an approximation to the integral of Ax) taken over [1, 6]. 

To generate 11 sample points, we mustuse M = Sand = (0 1)/1I0=1/2. Using 
fiormula (4c), the computation is 


1 ] 
3 ) = 一 TDTTHOD)+3SUOO+T7G)T+TT+TG) 


2 
十 了 CA 信 十 注 提 十 太 罗 十 8) 十 大 基 )) 


1 
一 (2.90929743 十 1.01735730) 


十 了.30807174 十 1.68305284 十 1.24319750 十 1.02872220) 
2 
十 了 (2.63815764 十 1.97931647 十 1.43530410 十 1.10831775 十 1.00024140) 


| 1 2 
一 E(03.92665499) 十 了 (6.26304429) 十 了 (8.16133733) 
= 0.05444250 十 2.08768143 十 $.44089157 = 8.18301550， 


Error Analysis 


The significance of the next two resujts is to understand that the error terms 忆 7r( 户 加) 
and 无 y(P) for the composite trapezoidal rule and composite Simpson rule are of 
the order Op and O(P4)， reSpectively，This shows that the error for Simpson's 
rule converges to zero faster than the error for the trapezoidal rule as the step size 大 
decreases to zero. In cases where the derivatives of 让 (xz) are known, the formulas 


OO 炙 已 (reyp14 
(月 = 一 and (月 = 
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can be used to estimate the number of subintervals required to achieve a specified 
accuracy. 


Corollary 7.2 (ITrapezoidqal Rule: Error Analysis). Suppose that [a, 中 is subdi- 
vided into M subintervals [xxk, x+1] of width 六 = (Pa)/M. The composite trape- 
zoidal rule 


M 1 
(7) 7 坟 几 = 了 WO+TO)) 二 六 放 Ce) 


大 一 1 


jls an approximation to the integral 


pb 
(9) 1 Jo0 dr 三 了 (LA PDT+ETCA 有 


Furthermore, 放 /< C2[a, D], there exists a value c with wa < c < b so that the emor 
term FE7T( 广 由) has the form 


(GO(c)p 


(9) ETr(1f 各 = 1 


一 00 


Proof We first determine the error term when the rule is applied over [xzo, x1]. Inte- 
grating the Lagrange polynomial Pi (xz) and its remainder yieldqs 


“ < < O) 
(10) 1/ Tax= meoax+ 上/ 人 20) CO) 
X0 居 


0 20 21! 
Theterm (x xzo)(x xl) does not change sign on Exzo, zl, and OK(c(z)) is contin- 


Uous. Hence the second Mean Value Theorem for integrals implies that there exists 8 
value cl So that 


天 1 
(11) 1/ jc) dx = 7( 加 十 万) 十 fen | 人 2 X1) 0 
xz0 国 ! 


Use the change of variable x = x0 十 At in the integral on the right side of (1 1): 





艺 (2) 1 
三 rod=3p+ 衣 + 人 ht OP DAdt 
X0 0 
(2) 3 1 
412 -2(P+ 记 + 大 Co 人 (全 有 Dd 
2 2 0 
JO(cDR3 


瑚 
= 了 (Jo 十 力 ) 1 
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Now we are ready to add up the error termas for all of the intervals [xx x+1l: 


九 好 天 
rm= 六 厂 Au 


4 大 =1v 了 1 
| < 有志 
二 之 了 CCu 1 十 fc) 五 2/ (c)， 


The first sum is the composite trapezoidal rule 7 了 (凡凡 ), mn the second term, one factor 
of P is replaced with its equivalent 严 一 (2 aqJ/AM,andthe resultis 


可 B oil1 志 oa 
1 Jo dx = 了 (上 户 门 3 ( 襄 业 7 (cb) 上 ， 


Thbe term in parentheses can be recognized as an average of values for the second 
derivative and hence is replaced by FC(c). Therefore, we have established that 


b 六 DJFC(c)P2 
re=TG 有 一 人， 
a 12 
and the proof of Coroliary 7.2 is complete. @ 
Corollary 7.3 (Simpson's Rule: Error Analysis). Suppose that [a, pb] is subdivided 


into 2Mf subintervals [k, xk+1l of equal width = (aa)/(CCAM)，、The composite 
Simpson rule 


1 SODD=ArwO+AoO+2 科 亿 》》 
《 VD=35O+7OD+ 了 这 1 Co 十 可 Co D 
is an apProximation to the integral 


已 
015) 1/ Fodz SC 月 二 BC 月， 


Furthermore, f F es C4[a, 外 ,there exists a value c with a < c < so that the error 
term. 瑟 5( 户 六 ) has the form 


(ac 


410) ES(f/, 及 = 180 


一 D(4). 


Example 7.7， Consider fx) = 2 十 Sin(2Vxz). Investigate the error when the compos- 
ite trapezoidal rule is used over [1, 6] and the number of subintervals is 10, 20, 40, 80， 
and 100. 
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Table 7.2 “The Composite Trapezoidal Rule for 
jx) =2+sin(2Vx) over [1,6] 

























M 天 7(/ 及 ET( 上 月 = Oo 
10 0.4 8.1938S4S7 0.010375S40 
20 0.25 8.18604926 0.002S7006 
40 0.124 8.18412019 0.00064098 
80 0.0625 8.18363936 0.00016015 


0.03125 8.18351924 0.00004003 


Table 7.2 shows the appbroximations 了 ( 六 由 . The antiderivative of 太 (x) is 


FU 二 27 VEcos(C2V 居 十 SeYX ev 


and thetrue value of the definite integral js 
6 X 一 6 
1/ jx)dx 一 上 (7) | 二 8.1834792077. 
1 x 一 


This value was used to compnute the values ET( 站 = 8.1834792077 了 (站 in Ta- 
ble 7.2， It is important to observe that when 疡 is reduced by a factor of 了 the Successive 
errors ET( 放 P) are diminished by approximately 于. This confirms that the order is O(1O. 

二 


了 Exarmple 7.8. Consider 让 (x) = 2 + Sin(2Vx). Investigate the error when the composite 
Simpson rule is used over [1, 6] and the number of subintervals is 10, 20, 40, 80, and 160. 
Table 7.3 shows the approximations S( 六 由 The tmue value of the integral is 
8.1834792077, which was used to compute the values ESs( 凡 用 = 8.1834792077 SC 站 
in Table 7.3. Itis important to observe that when P is reducedby a factor of 2 the successive 
errors ES( 放 AP) are diminished by approximately 而 . This confrms that the order is O(p4). 
. 本 


Example 7.9. Find the number M and the step size 产 So that the error T (AD forthe 
composite trapezoidal rule is less than 5 x 10 ”forthe approximation 户 dx S 了 ( 放 放 )， 

The integrand is jz) = LAxr and its first two derivatives are F(xz) 一 1]x2 and 
了 OOx) = 2/x3.The maximum value of |fCD)(xz)|taken over [2,7] occurs atthe end Point 
X 二 2,andthus wehave the bound | PC)(c)| < < | Fo2)(2)| = 1, for 2 < c<7. This is used 
with formula (9) to obtain 


| ojfoOc2 0O 2 5j 
(17) Pr- 一 人 
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Table 7.3 The Composite Trapezoidal Rule for 
Cr) =2 十 sin(2Vxz) over [1,6] 






BE5(N= OO4) 








| 8.18301549 0.00046371 
10 8.18344750 0.00003171 
20 8.18347717 0.00000204 
40 8.18347908 0.00000013 


8.18347920 0.00000001 


The step size 严 and number M satisfy the relation 疡 二 S/M, and this is used in (17) to get 
the relation 


<Sxl0 9. 





(18) Er( 六 有 < 有 


Now rewrite (18) so that it is easier to Solve for MI: 


25 

一 x10? < M2. 
(19) 入 xl0 < 
Solving (19), we find that 22821.77 < M, Since M must be an integer, we choose M = 
22,822, and the corresponding step size is 疡 = $/22,822 = 0.000219086846. When the 
composite trapezoidal rule is implemented with this many fonction evaluations, there is a 
possibility that the rounded-off function evaluations will produce a significant amount of 


error When the computation Was Performed, the result was 
T(j > 一 1.252762969 
”22,822/ ， 


Which compares favorably with the true value 记 dxy/x 一 ln(xz)FE》 一 1.232762968. The 
erroris smaller than predicted because the bound for| 2)(c)l was used. Experimentation: 
shows that it takes about 10,001 fbnction evaluations to achieve the desired accuracy of 
Sx 10 ,and when the calculation is performed with M = 10,000, the result is 


5 


The composite trapezoidal rule usually requires a large number of function eval- 
”uations to achieve an accurate answer This is contrasted in the next example with 
Simpson's rule, whbich will require significantly fewer evaluations， 
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卫 xample 7.10. Find the number AMf and the step size 疡 so that the error 开 s( 太 PP) for the 
composite Simpson rule is less than $ x 10 ? for the approximation 万 dx SS 六 有. 

The integrand is _F (xz) = 1/x, and F(x) = 241xz5. The maximum value of | 六 (ol 
taken over [2, 7] occurs at the end point x 三 2, and thus we have the bound | 太 (人 (c)| < 
JJCO)= iftor2 <c<7.Thisis used with formula(16) to obtain 


Le ofoOcoi CO 2 和 玉 


The step size 户 and numhber M satisfy the relation 严 = S/(2M),and this is used in (20) to 
get the relation 





<Sx10 ?. 


(CD) 12s(j 人 ET 芭 


Now rewrite (21) so that it is easier to Solve for AM: 


125 
一 ~- x 10? < M14. 
(22) 了 硬 义 苹 


Solving (22), we find that 112.95 < M. Since M must be an integer we chose 1M = 113， 


and the corresponding step size is 户 = 3/226 = 0.02212389381，When the composite 
Simpson rule was performed, the result was 


5 
, 一- | = 1.252762969， 
s(/ 雹 】 ? 


Which agrees with 记 dx/xr 三 Inc) | 三 = 1.232702968. Experimentation shows that it 
takes about 129 function evaluations to achieve the desired accuracy of x 10 9》 and when 
the calculation is performed with M = 64, the result is 


5 
,， 一 |] = 1.2532762973， 
人 (/ 忘 ) 9 可 


So we see that the composite Simpson rule using 229 evaluations of 太 (x) and 
the composite trapezoidal rule using 22,823 evaluations of F(x) achieve the same ac- 


curacy，In Example 7.10, Simpson's rule required about 高 the number of function 
evaluations， “ 
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Program 7.1 (Composite Trapezoidal Rule)， To approximate the integral 


九 厂 4 好 1 
yaxs 57O+AODT Fen 
4 类 一 1 


by sampling Fox) atthe M 十 1equally spaced points xf 一 4 十 人 fork = 0, 1,2， 
,AI. Notice that x0 一 a andxh 一 站 . 





function s=traprl(f,a,b,M) 
XInput -~ T is the integrand input as a String ? 工 ， 


包 - a and b are Upper and 1ower Limits of integration 
六 -~ M is the number of subintervals 
YXoutput - s is the trapezoidal rule sum 
h=(b-a)VM; 
S=0 ; 
for k=1:(M-1) 
X=a+hkkK; 
S=S+fteval(ft ,Xx) ; 
enaQ 


S=hy#k(feval(f,a)+feval(f,b))/2+hys ; 





Program 7.2 (Composite Simpson Rule). To approximate the integral 






用 28 4 4 妈 
1/ J(Ddars3CO+AOD)+ 王 之 Job 二 本 27Gmx D 


by SP J(Cx) atthe2M 十 1equahy spaced points xx 一 a 十 雁 ， for 大 = 0, 1， 
2, ...，2AMf. Notice that xo0 一 4 and x21Mg 一 忆 . 





function sS=simprl(f,a,b,M) 


%InPut ” - f is the integrand input as a string :了 ， 
为 -~ a and b are Upper and 1ower 1imits of integration 
六 -~ NM is the number of subintervals 


% Dutput - 8 is the simpson rule sum 
hbh=(b-a)/(2*M) ; 
S1=0O; 
S2=0 ; 
for Kk=1:M 
X=a+h*(2*+k-1) ; 
sl1=sl+feval(, 蔗 ) ; 
end 
for k=1:(M-1) 
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X=a+Dh 冰 2 光 ; 
S2=S82+feval(f ,x) ; 
endQ 


S=hk(feval(f,a)+feval(f,b)+4*s1+2+S2)7/3; 


了 Exercises for Composite ITrapezoidal and Simpson's Rule 





1， ( Approximate each integral using the composite trapezoidal rule with M = 10. 
(iD Approximate each integral using the composite Simpson rule with M = 5. 


@ /+z ldxz 四 用 C+sinCvV)dz (9 Jsdxz/wE 
(局 xz2e <dr (人 Ji2xcosoDdaxz  。 田 订 sinCzje dx 


2.。 工 en8g 旨 of a curve，The arc length of the curve y = xx) overthe interval a <x < 忆 


1S 
忆 
length = 1 VJI+ (CFan dx. 


(iD Approximate the arc length of each function using the composite trapezoidal 


rule with M = 10. 
(ii Approximate the arc length of each function using the composite Simpson rule 
with M = 5. 
(3) Fo) =23 for 0<xz<v1l 
(b) xz) 一 sin(x) for 0<x7x<xT/4 
(cj) CC) 一 e < for 0<x<1 


3. surface area，The solid of revolution obtained by rotating the region underthe curve 
?= Ja),wherea <xz <pD,abouttheX-axis has Surface area given by 


已 
area 一 2 Co)VI1+(CFPOD)2dx. 


(人 Approximate the Surface area Using the composite trapezoidal rule with M = 


10. 
( Approximate the surface area using the composite Simpson rule with AM = 5. 
() Foxz) =x3 for 0<7r<1l 


(b) xc 一 Sin(xz) for 0<xY<T/4 
(O Go) 一 ex for 0<xrx<1l 
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4. 


(a)  Veiify that the trapezoidal rule (M 一 1, 疡 = 1)is exact for polynomials of 
degree < 1 of the form jx) = clx 十 coover [0, 1]. 

(b) Use the integrand (xz) 一 c2xX2and verify that the error term for the trapezoidal 
rule (M = 1 天 一 1)overthe interval [0, 1] js 


Ga)7FO) CO 和 好 


E7( 记 六 二 菇 


.。(3) Verify that Simpson's rule Gd = 一 1， 六 一 = 1 is exact for polynomials of degree 


< 3ofthe form 丰 (x) 一 C3X3 了 c2x2 十 Clx 十 co Over [0, 2]. 
(bj) Usethe integrand 让 (x) 一 C4X 4and verify that the error term for Simpson's rule 
(ff = 一 1overtheinterval [0,2] is 


人 qdGR4 


无 S( 放 用 二 160 


。Derive the trapezoidal rule (AMf 一 17 = 1) by using the method of undetermined 


coe 仁 cients. 


(a) Find the constants wo and w1 So that 用 gdt 一 Wog(0) 十 W18(1) is exact for 
the two functions 8( 人 一 1andg() 一 上 

人 ) Use the relation Frxo 二 Ph 一 8 andthe change of variablex 一 20 十 1tand 
dx =Adritotranslate the trapezoidal rule over [0, 1] to the interval [xo, xl]， 

Entforpart(a). You will get alinear System involving the two unknowns w0 andu 1. 


。Derive Simpson's rule (M = 1, 瑚 一 1byusing the method ofundetermined coe 侍 - 


cients. 

(aHj) Find the constants WwW0，Ww1, and 册 2 so that 厅 8O di 三 W08(0) 十 18(1) 十 
W28(2) is exact for the three functions g() 一 1 8 人 一 忆 andg(f) = 弓 . 

(pb) Use the relation (xzo 十 ji) 三 8 andthe changeofvariabley =xo 十 Atand 
dx 一 Aditotranslate the trapezoidal rule over [0, 2] to the interval [xo, x21. 


Hintforpart (3a). You will get a linear system involving the three unknowns 0o,， Wi1， 
and 岂 2. 


、Determine the number M and the ipterval width 产 so that the composite trapezoidal 


rule for 好 Subintervals can be used to compnute the given integral with an accuracy of 
5Sx10 9? 


3 1 2 
(3) 所 COS(X) Gx (b) 1/ Cx (C) 人 XE < dx 
/6 2 5 YY 0 
Hintforpart(c). FrD) 一 人 2)ex 


Determine the number M and the interval width 疡 so that the composite Simpson rule 
for 2M subintervals can be used to compute the given integral with an accuracy of 
5x 10 》. 


3 1 2 
(3) 三 6cosCD) 中 (b) 1/ 了 dx (c) 1/ Xe “Gdx 
Hintforpart(c). Fr) = 人 4)ex 
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10， Consider the definite integral /0 cos(x) dx = 2sin(0.1) = 0.1996668333， The 
following table gives approximations using the composite trapezoidal rule. Calculate 
ET( 记 1) 三 0.199668 了 (人 门 and confirm that the order is Op2). 





ET(HA 甩 = OO 








0.1990008 
0.1995004 
0.1996252 
0.1996564 
0.1996642 








11，Consider the definite integral /73。cos(z) dx = 2sin(0.75) = 1.363277520，The 
following table gives approximations using the composite Simpson rule， Calculate 
ES( 放 1 = 1.3632775 SC 站 andconfirm that the order is O(14)， 


1.3658444 
1.3634298 
1.3632869 
1.3632781 






ESs( 站 = On) 











12，Midpoint rule， The midpoint rule on [xo, xl1] is 


X1  xX0 





X1 严 玉 3 
1 Je)dx = (am 十 2) 十 二 7 (cy， where 太一 
X0 


(a) Expand 下 (xz),the antiderivative of Fox),in a Taylor series about xo 十 彤 /2 and 
establish the midpoint rule on [xo, x1. 

(b) Use part (a) and show that the composite midpoint rule for approximating the 
integral of 让 (xz) over [ac, p] is 


习 1 已 
MG 朋 =A2 7 人 ar 人 引 ) 当 ， where 户 一 
大 =1 


This is an approximation to the integral of F(x) over [ca, b], and we write 





已 
Joo0dx sMCF 月 ， 
(OO Show that the error term 开 M( 太 jp) forpart (b) is 
有 他 OO)(c)12 2 
EM( 广 及 一 五 记 / Co = 一 一 人 一 一 =009) 


13.， Use the midpoint rule with M = 10to approximate the integrals in Exercise 1. 
14，Prove Corollary 7.3. 
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Algorithms and Programs 
人 | 


|. 


(al) For each integral in Exercise 1, compnute M and the interval width 疡 so that the 
composite trapezoidal rule can be used to compute the given integral with an 
accuracy of nine decimal places, Use Program 7.1 to approximate each integral, 

() For each integral in Exercise 1, compnute M and the interval width 户 so that the 
composite Simpson's rule can be used to compute the given integral with an 
accuracy of nine decimal places. Use Program 7.2 to approximate each integral. 


。Use Program 7.2 to approximate the definite integrals in Exercise 2 with an accuracy 


of 11 decimal places. 


。The composite trapezoidal rule can be adapted to integrate a fonction known only at 


a Set of points，Adapt Program 7.1 to approximate the integral of a function over 
an interval [a, p] that passes through M given points，(Note. The nodes need not 
be equally spaced.) Use this program to approximate the integral of a function that 


passes through the points | (VE+Ti ,大 1/ 3) | 


The composite Simpson s rule can be adapted to integrate a function known only at 
a set of points，Adapt Program 7.2 to approximate the integral of a function over 
an interval [a, )] that passes through AMf given points，(Note. The nodes need not 
be equally spaced.) Use this program to approximate the integral of a function that 


passes through the points {(VET+T ,大 1L/ ?) | 


。 Modify Program 7.1 so that it uses the composite midpoint rule (Exercise 12) to 


approximate the integral of x) over [fa, 中 .Use this program to approximate the 
definite integrals in Exercise 1 with an accuracy of 11 decimal places， 


.Opbtain approximations to each of the following definite integrals with an accuracy of 


ten decimal places. Use any of the programs from this section. 


1/4z 胡 105 1 
(a) 由 Sin(1/xr)Gx (b) 上 


一 一 一 -dx 
1/7z 页 +10 5 sin(1/x) 


。TIhe following example shows how Simpson's rule can be used to approximate the 


solution of an integral equation, The equation v(z) 一 x2 十 0.1 几 (xz2 十 ji Qt is to 
be solved using Simpson's rule with 天 二 1/2. Let 如 = 0,0 =1/2,andp5a = lithen 


人 (好 十 Du(D dt 人 十 0)uo 十 4(x2 十 2 十 Ccz 十 1)v2). 
Let 
(D uCxzn) = zx 十 0 十 0)a0 十 4(x2 十 2 十 (x2 十 1)v2)). 


Substituting xo = 0, xl = 1/2, and x2 一 1 into equation (1) yields the system of 
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linear equations: 
1 
V0 一 0 十 而 ((0)0 十 2u1 十 v2) 


工 1 .1 | 
(2) U1 三 玫 十 而 (2 十 351 十 也 2) 


1 
V2 一 工 十 厅 (oo 十 6v1 十 222) 


Substituting the solution of system (2) (uo = 0.0273, ul = 0.2866, uv = 1.0646) into 
equation (1) and simplifying yields the approximation 


(3) ur) s% 1.037305x2 十 0.027297. 


(3) As a check, substitute the solution into the Hght-hand Side of the integral equa- 
tion, integrate and simplify the right-hand side, and compare the result with the 
approximation in (3). 

(pb) Use the composite Simpson rule with 彤 = 0.5 to approximate the solution of 
the integral equation 


工 
uCx) 一 X2 +o1 1 (2 十 门 U(D dz. 
0 


Use the procedure outlined in part (a) to check your solution. 


Recursive Rules and Romberg Integration 


Im this section we show how to compute Simpson approximations with a special linear 
combination of trapezoidal rules. The approximation will have greater accuracy if one 
uses a larger number of subintervals， How many should we choose? The sequential 
process helps answer this question by trying two subintervals, four subintervals, and 
SO on, Until the desired accuracy is obtained，First, a Sequence {T(V)] of trapezoidal 
rule approximations mnust be generated. As the number of subintervals js doubled, the 
number of function values is roughly doubled, because the function must be evaluated 
at all the previous points and at the midpoints of the previous subintervals (see Fig- 
ure 7.8). Theorem 7.4 explains how to eliminate redundant function evaiuations and 
additions. 


Theorem 7.4 (Successive Trapezoidal Rules),， Suppose that J > 1 and the points 
[to = a+ 厌 ] subdivide [a, Dinto 27 = 2M subintervals of equal width 忆 一 
(的 /27. The trapezoidal rules 7( 太 加 and 7( 户 21) obey the relationship 


7(/ 21) 


， 4 
(D T(/ 朋 = 一 汪 一 十 2》 Gok 1 
天 一 


一 一 一 一-eaeeamrainieeeeemaeenrr 一 一- 一 一 一 


SEC.7.3 RECURSIVE RULES AND ROMBERG INTEGRATION 369 


?= .xD) ?了 = 


(人 0) 人 


?7=n 





(c) (qd) 


Figure 7.8 (a) 了 (0) is the area under 20 = 1 trapezoid. (b) 了 (1) is the area under 
21 =2 trapezoids. {c) 了 (2) is the area under 22 一 4 trapezoids. (d) 7 了 (3) is the area 
under 23 = 8 trapezoids. 


Definition 7.3 (Sequence of Trapezoidal Rules)、 Dehne 7(0) = (PR/2)(CF(a) 十 
JJ)), which is the trapezoidal rule with step Size 六 一 4 Thenforeach 了 > 工 
deftne 了 (J) = 了 (有 , where 了 (由 is the trapezoidal rule with step size 瑚 一 
(ba)/]27. 全 


Corollary 7.4 (Recursive Trapezoidal Rule). Start with 7 了 (0) = (PP/2)(F(a) 十 
了 (0))，Then a Sequence of trapezoidal rules {T(J)} is generated by the recursive 
formula 


4 
(2) TO) = 一 人 过 +Hy 7eox D) ， for J=1 2 ...， 
天 一 1 


where 产 = ( al)/27 and ft 一 4 十 大 }， 


Proof For the even nodes z0 < 22 < …: < 2M 2 <X2M， Weusethe trapezoidal 
rule with step Size 25: 


27 
(G3) 7(J 1 = 本 (ja 十 2 户 十 2 十 十 2PM 4 二 2P 2 十 户 M). 


For allof the nodes x0 < 2 < 如 < <X2M 1< 3X2M,weusethetrapezoidal rule 
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with step size 严 ; 


忆 
(4) T(7) 一 (j 二 2 刀 十 2 户 二 二 27PM 2 十 2PM 1 十 户 M)， 
Collecting the even and odd subscripts in (4) yields 
和 jh 
(5) T(J) = 本 ( 骨 十 2 户 十 十 2 2 十 户 N) 十 志 2 Pie 1 
K=1 


Substituting (3) into ($) results in 7 了 (J) = 了 (7 了 /2 十 天 人 寻 ) JK 1 andthe proocf 
of the theorem ls complete. @ 


Example 7.11.。 Use the sequential trapezoidal rule to compnute the approximations 了 (0)， 
7T(),7(2),and7(3) forthe integral 广 dx/x 一 in(9) ln(1) = 1.609437912. 

Table 7.4 shows the nine values required to compute 了 (3) and the midpoints required 
to compute 了 (1), 7 了 (2), and 了 (3). Details for obtaining the results are as follows: 


4 
When 天 一 4: 了 (0) 一 了 了 (1.000000 十 0.200000) 三 2.400000. 


When = 2 T(D = re 十 2(0.333333) 


一 _ 1200000 十 0.606666 = 1.860666. 
When 天 =1: 了 (2) = 分 十 1(0.500000 十 0.230000) 
= 0. 0 十 0.750000 = 1.683333. 
When 户 三 5 7 了 (3) 三 全 十 二 (0 6606667 十 0.400000 
4 02857 14 十 0.222222) 
一 0.841667 十 0.787302 = 1.628968. 国 


Our next result shows an important relationship between the trapezoidal rule and 
Simpson's rule，When the trapezoidal rule is computed using step sizes 2A and 六， 
the result is 了 ( 几 2p) and 了 (六 四,respectively. These values are combined to obtain 
Simpson's rule: 


47(/ 站 了 T(C/26) 
一 


Theorem 7.S (Recursive Simpson Rules). Suppose that {T(J)} is the sequence of 
trapezoidal rules generated by Corollary 7.4. HI 7 > 1 and S(J) is Simpson's rule for 
27 subintervals of fa, b],then S(y) andthe trapezoidal rulesT(J 1) and7(J) obey 
the relationship 


(0) SC/ = 


(7) S(J) = 一 for 了 二 1， 2， 
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Table 7.4 The Nine Points Used to Compute 7 (3) and the Midpoints Required to Compute 
T(D,T(2), and 7(3) 


End points for Midpoints fof Midpoints for 
computing (0) | computing 了 (1) | computing 7(2) 






Midpoints for 
computing 了 (3) 










1.000000 
0.660667 
0.300000 
0.400000 
0.333333 
0.285714 
0.230000 
0.222222 
0.200000 


Proof The trapezoidal rule 7(7) with step size jyields the approximation 


天 
(9) 1 Jaxz) dx 福 IC1a 十 2 记 十 2 户 十 十 2PM 2 十 2 户 H 1 十 户 M) 
他 
一 了 (J). 
The trapezoidal rule 7 了 (J 1 with step size 27 produces 
也 
9 /fedrshh+2 户 +…+2ju a+Ja0=TO 


Multiplying relation (8) by 4 yields 


已 
(10) 4 Jo0DJdx SR 四 十 4 记 +4 户 十 … 十 4 2 十 4PM 1 二 2) 
人 
一 47(J). 
Now subtract (9) frfom (10) and the result is 


六 
4D) 3 jx)dxsRp+4 户 十 2 户 二 十 2Pir 2 十 4PM 1 二 Pi) 
一 47(J/) T(J 1)， 


This can be rearranged to obtain 


? 玉 
1 JC0 人 人 5( 加 二 4 三 十 2 户 十 十 2 2 十 4PM 1 十 户 M) 


47(J) TU 二 
= 一 一 一 一 . 
The middle term in (12) is Simpson's rule S(J) = 9( 放 有 and hence the theorem is 


(12) 


Proved. @ 
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Exampjle 7.12， Use the sequential Simpson rule to compnute the approximations S(]1)， 
S(2), and S(3) for the integtral of Example 7.11. 
Using the results of Example 7.11 and formula (7) with y = 1, 2, and 3, we compute 


47(D 7(0) 4(1.866666) ”2.400000 


SC) = 5 4 二 1.688888， 
47CO) ”7T() 401.683333) 1.866666 
SO) = 一 =- 人 一 1.622222， 
47G)” TO) 4(1.628968) 1.683333 
SG) = 二 一 人 一 1.610846. 四 


In Section 7.1 the formula for Boole's rule was given in Theorem 7.1. It was 
obtained by integrating the Lagrange polynomial of degree 4 based on the nodes x0， 
X1, X2，X3， and x4， An alternative method for establishing Boole's rule is mentioned 
in the exercises，When it js applied AM times over 4Af equally spaced subintervals of 
[&, pof step size 玉 一 ( CC)/(4AM)， wecallit the co11aposile Booje rie: 


2 有 攻 
(13) 8( 刀 思 = 在 》 (JU 4+32Jk 3 二 12K 2 十 32Jk 1 十 7 
天 一 | 


The nextresult gives the relationship between the sequential Boole and Simpson rules. 


Theorem 7.6 (Recursive Boole Rules). Suppose that {S(VJ)} is the sequence of 

Simpson's rules generated by Theorem 7.3. 玉 J > 2 and B(J) is Boole's rule for 

27 subintervals of fa, b], then B(J) and Simpson's rules S(J 1) and $(J) obey the 

relationship 

16S(J) SC 1) 
15 

Proof The proof is left as an exercise for the reader. e@ 


(14) 有 B(J) 三 for ] 一 2，3，..….. 


卫 xample 7.13. Use the sequential Boole rule to compute the approximations 已 (2) and 
了 (3) for the integral of Example 7.11， 
Using the results of Example 7.12 and formula (14) with 7 = 2 and 3, we compnute 


16S(2) SG) 16(1.622222) 1.688888 


瑟 (2) 一 1 1 一 1.617778， 
164(3) SC 16(1.610846) 1.622222 
有 (3) = 2 一 人 一 1.6010088. 台 


The reader may Wonder what we are leading up to，We will now show that for- 
mulas (7) and (14) are Special cases of the process of Romberg integration。 Let us 
announce that the next level of approximation for the integral of Example 7.11 is 

64B(3) BC2) 64(1.610088) 1.617778 
63 63 
and this answer gives an accuracy of five decimal places. 


三 1.009490， 
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Romberg Integration 


In Section 7.2 we Saw that the error terms ET7T( 放 P) and ES(CAP) forthe composite 
trapezoidal rule and composite Simpson rule are of order O(P2) and DO(p), respec- 
tively. It is not difficult to Show that the error term 有 65( 放 六) forthe composite Boole 
rule is of the order O(P6). Thus we have the pattern 


已 

(15) 1 Foodz = 了 (六 站 +OG)， 
已 

(10) 1 fdxr=3S( 站 +OU)， 
已 

(17) 1/ Foo0dxr= 有 (站 二 O09). 


The pattern for the remainders in (15) through (17) is extended in the following 
Sense. Suppose that an approximation rule is used with step Sizes 疡 and 27A; then an al- 
gebraic manipulation of the two answers is used to produce an improved answer Each 
Successive level of improvement increases the order of the error term from O(A2N) 
to OO2w+2). This Process, called Romtzbperg Prlegratfiom, has its strengths and weak- 
DeSSeS. 

The Newton-Cotes rules are Seldom used past Boole's rule. This is because the 

nine-point Newton-Cotes quadrature rule involves negative weights, and all the rules 
Past the ten-point ruje involve negative weights. This could introduce loss of signif- 
icance error due to round off， The Romberg method has the advantages that all the 
weights are positive and the equally spaced abscissas are easy to compnute， 

A computational weakness of Romberg integration is that twice as many function 
evaluations are needed to decrease the error from O(Pp2Nw) to O(pn2w+2). The use ofthe 
sequential rules will help keep the number of computations down. The development 
of Romberg integration relies on the theoretical assumption that, 坟 < CAwf[a,b] 
for all N, then the error term for the trapezoidal rule can be represented in a series 
involving only even powers of j; that is， 


所 
(8) 1 JoD dx =T( 丰 上 + 林 ( 太 月 ， 
WwWhbere 
(19) ET( 户 月 =alj2 二 az 计 4 二 api 十. ， 


A derivation of formula (19) can be found in Reference [1S3]. 

Since only even powers of hh can occur in (19), the Richardson improvement pro- 
Cess is used Successively first to eliminate al , next to eliminate az, then to eliminate 03， 
and So on、This process generates quadrature formulas whose error terms have even 
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orders OP 0 DO(p8), and so on We shall show that the first Improvement is 
Simpson's rule for 2M intervals, Start with 7( 六 21) and7(AA)andtheequations 


忆 
(20) 1 Jo0adz=T(A21) 二 ai412 十 oz1684 十 aa6416 十 …. 
好 
and 
已 
《20 1/ Fo0dz=T(P 用 +a12 上 +a 有 二 ae 十 ， 
1 


Multiply equation (21) by 4 and obtain 
(22) 4 厂 Foodxr =47( 六 站 二 al412 十 az414 十 a3416 十 …. 
a 
Eliminate al by subtracting (20) from (22). The result is 
(23) 3 1 ， Fo0Dadxr=47( 有 站 TCFP2 有 op1214 036016 
丰 


Now divide equation (23) by 3 and rename the coeffcients in the series: 


已 
(24) | 1 加 帮 = 开光 下 十 思 届 十 思 打 十 和 


As noted in (6), the first quantity on the right side of (24) is Simpson's rule SC 六 及. 
This shows that 天 g( 放 由 involves only even powers of 疡 : 


已 
(25) |/ Fo)dax 三 S( 记 站 十 太 了 十 bj16 十 及 三 十 


To show that the second improvement is Boole's rule， start with (25) and write 
down the formula involving S( 刻 27): 


(26) 1 GOD)Jdxr = SCP2 间 十 忆 1684 十 6416 十 5325628 十 ， 
分 
When pl is eliminated from (25) and (26), the result involves Boole's rule: 
1S 15 15 


D248h6 所 324078 
15 15 








一 有 (六 有 
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The general Pattern for Rombersg integration rejies on Lemma 7.1. 


Lemma 7.1 (Richardson's Improvement for Romhberg Integration)， Given two 
approximations RC27 KE HandRA,K lforthequantity @that satisfy 


(28) @=ROK 1D+clp2k& 十 coP2K+2 十 .， 
and 
(29) @= RCR 天 1 上 cl4K RE 十 co4K+TLR2KT2 十 ， 


an Improved approximation has the form 


_ 44R KE 1D RO2P 天 划 


G30) 2 二 


+DOO 2 天 十 2 )， 
The proof is straightforward and is left for the reader， 


Definition 7.4. Define the sequepnce {R(J 天) :了 二 天 } 宛 0 of quadrature formulas 
for Fx) over [a, 由 as follows 


R(J,0)=7(J/) fory > 0,is the sequential trapezoidal rule. 
(31) RCH)=S(J) fory > listhe sequential Simpson rule. 


R(72) 三 BO) fory > 2,isthe sequential Boole's rule. 人 


The starting rules, {R(J, 0)j,are usedto generate the first improvement {R(7， 1D)}， 
which in turn is used to generate the second improvement [R(J, 2)}. We have already 
Seen the patterns 


4LR(J,O) RCIJ 10) 


R(J, TD = 1 for 了 >1 
6G2) 42R(y7 机 Rd 1 1 
RCIJ,2) 一 一 for 了 > 2， 


which are the rules in (24) and (27)] stated using the notation in (31). Tbe general rule 
for constructing improvements is 


4&R(J KE 1) RJI 1LKE DT 


(33) RCR) = 本 


for / > 天 . 
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Tabjie 7.$S ”Romberg Integration Tableau 


















民 (7,0) 
Trapezoidal 


RD 
Simpson's 


及 (J,3) 
Third 
improvement 


R(7, 4) 
Fourth 
improvement 














Table 7.6 ”Romberg Integration Tableau for Example 7.14 



















民 (J,0) RD 及 (J,2) 及 (J,3) 




























Trapezoidal Simpson's Boole's Third 
了 rule rule rule improvement 
0 0.78S398163397 
1 1.726812656758 2.040617487878 
2 1.960534166564 2.038441336499 2.038296259740 
3 2.018793948078 2.038213875249 2.038198711166 2.038197162776 
4 2.033347341805 2.038198473047 2.038197446234 2.038197426156 
5 


2.036984954990 2.038197492719 2.038197427363 2.038197427064 








For computational purposes, the values R(J, 天 ) are arranged in the Romberg integra- 
tion tableau given in Table 7.5. 


Example 7.14. Use Romberg integration to find approximations for the definite integral 


了 /2 元 元 2 
人 (2 十 x 十 DcosOJdx 一 2 十 本 十 玫 = 2.038197427067.. .， 
0 


The computations are given in Table 7.6. In each column the numbers are converTging 
to the value 2.038197427067 ..… The values in the Simpson's rule column converge faster 
than the values in the trapezoidal rule column, For this example, convergence in columns 
to the right is faster than the adjacent column to the left. 

Convergence of the Romberg values in Jable 7.6 is easier to see 让 we look at the error 
terms 妨 (J, 天 ) = 2 二 7/2 十 区 /4 尺 (J 开 ). Supposethatthe interval widthis 庆 一 5 a 
and that the higher derivatives of 太 (x) are of the same magnitude. The error in column 天 
of the Romberg table diminishes by about a factor of 1/2 和 +?2 一 1/4K+1 as one progresses 
down its rows, The errors 已 (/, 0) diminish by a factor of 1/4, the errors 无 (J, 1) diminish 
by a factor of 1/16, and so on. This can be observed by inspecting the entries { 天 (J, 天 )} in 
Table 7.7. 本 
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Table 7.7 ”Romberg Error Tableau for Example 7.14 











377 
































J| E(1,0=O02) | ED= 004) | EC2) = Op6) | EC1,3) = Op8) 
一 | | 上 - 片 一 十 

0 | 5 ea | 1.252799263670 

1 2 5 和 | 0.311384770309 | “0.002420060811 

2 | 2 了 和 | 0.077663260503 | “0.000243909432 | 0.000098832673 

3 | 2 5 “4 | 0.019403478989 | 0.000016448182 | “0.000001284099 | ”0.000000264291 

4| 2 0.004850085262 | ”0.000001045980 | “0.000000019167 | “0.000000000912 

5 2 0.001212472077 | “0.000000065651 | 0.000000000296 | “0.000000000003 

3 | 





Theorem 7.7 (Precision of Romberg Integratiom). Assume that < CT+2[a，, 0] 
Then the truncation error term for the Romberg approximation is given in the formnula 


已 
aq) 1 CODJdx = RCJ 天) 十 KP2ET2FCK+2(CJ KK) 
一 RCI, 开 ) 十 OO2K+2)， 


where 瑚 一 (ba)/27, 5 is aconstant that depends on 玉 , and cJK E [a,p]; see 
Reference [1S3], page 126. 


Example 7.1$S. Apply Theorem 7.7 and show that 
2 
人 10x? dx = 1024 三 R(4, 4)， 
0 


The integrand is fxz) = 10x9, and fdO(x) 三 0. Thus the value 天 = 4 will make the 
error term identically zero. A numerical computation will produce R(4, 4) 一 1024. 国 






Program 7.3 (Recursive Trapezoidal Rule)，To approximate 


忆 玉 27 
1/ Ce)adx 包 7 2 1) 十 xp)) 


by using the trapezoidal rule and successively increasing the number of subintervals 
of [c,]. The 7th iteration samples F(xz) at 27 十 1 equally spaced points. 


function T=rctrap(f,a,b,n) 
%Input - 人 is the integrand input as a String ?下 ) 
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从 -~ a and b are Upper and lower limits of integration 
久 -mn is the number of times for recursion 

YoOutput - T is the Tecursive tIapezoidal rule List 

M=1 ; 

Ph=b-a; 


T=zeros(1,n+l) ; 
T(1L)=hrk(feval(f,a)+feval(ft,b))/2; 
for j=1:n 
M=2*M ; 
h=hV2; 
S=0 ; 
for Kxk=1:M/2 
X=a+hk(2#+K-1) ; 
8=8+feval(f,x) ; 
endq 
T(j+1)=T(j)V/2+hys ; 
end 









Program 7.4 (Romhberg Integratiom). To approximate the integral 


忆 
1 (COxzJdx 之 RD) 


by generating a table of approximations R(C,K) for J/ > 天 and using 
R(J 十 1 了 +lasthe final answer The approximations 尺 (J, 天 ) are Stored in 
a Special lowertriangular matrix. The elements R(J, 0) of column 0 are computed 
using the sequential trapezoidal rule based on 27 subintervals of [ae, b]; then R(V, 天 ) 
is computed using Romberg's rule. 


The elements of row .are 
民 (7 1 及 1K 1 
RCRK)=ROJ 开 1 十 2 


for1l < KK < /The program is terminated in the (y 十 1U)st row when 
IRGCUV JI) RCI +1Ly7 +HDI<tol. 





function [R,quad,err,h]=romber(f,a,b,n,tol) 


%Input -ff is the integrand input as a String :T) 

从 - a and b are Upper and lower 1Limits of jntegration 
人 -~ D is the maximnum Dumber of rowSs :in the table 

纹 - tol is the tolerance 

Y%output - R is the Romberg table 

办 -~ quad is the quadrature Value 


和 - er is the error estimate 
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从 - h ie the smalLlest step size used 


R=zeros(4 ,4) ; 
R(1,1)=hx(feval(t,a)+fevalL(f,b))/2; 
While((err>tol)&(J<n))1(J<4) 


for P=1 :1 
X=a+h#k(2*p-17) 3; 
Ss=S+feval(T ,Xx) ; 


end 
R(CJ+l1,1)=R(J,1)V/2+hySsi 
M=2*xM ; 
for K=T1:J 
R(J+1,K+1)=R(J+1,K)+(R(J+1,K)-RCJ,K))VAC4 K-T1) ; 
end 
err=abs(R(J,J)-RCJ+1,K+1) ) ; 
end 


quad=R(J+1,J+1) ; 


Exercises for Recursive Rules and Romberg Integration 


1. For each of the following definite integrals，construct (by hand) a Romberg table 
(Table 7.5) with three rows. 


3 
人) 人 SC dr 一 0.6717578646..， 
0 ] 十 本 





3 

(D) 人 sin(4xJe 2 dx = 0.1997146621... 
0 
1 1 

(GO 刀 均 - 亏 必 一 18 


(gd) 五 一 Tdx= 4. 4713993943 . 


而 


(e) 同 Sin dx 一 1.1140744942 . 
10C27) 


关 


直 = 一 3.1415S92653S . .. 
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。 Assume that the sequential trapezoidal rule convergesto ZL (ie., limy 一 co7(V) = 也). 


(a) Showthat the sequential Simpson rule convergesto 工 (ie.,limy->eoo 9(J) = 也). 
(b) Show that the sequential Boole rule converges to ZL (ie., limy~oo BC7) = 志 ). 


。(a) ”Verify that Boole's rule (AMf 一 17 = ]) is exact for polynomials of degree < 5 


of the form 太 (x) 一 C5X5 十 cd4X4 十 … :十 clx 十 coover [0,4]j. 
(b) Use the integrand 矿 (x) 二 c6x6 and verify that the error term for Boole's rule 
(M =1, 闫 = Hoverthe interval [0, 4] is 


2( gc)pe 


。Derive Boole's rule (M = 1 天 三 1)byusing the method of undetermined coe 侍 - 


cients: Find the constants W0, 1, 2, W3, and W4 So that 
4 
1/ gdt = 08(0) 十 wig(D 二 28(C2) 上 au38(3) 十 id8(4) 


is exact for the five functions 8(1) 一 1 1， 1 0, and4. Fint You w 记 get the linear 
System: 


WwW0 十 WUI 十 WU 十 3 十 4 三 4 
WwW1 十 2 十 303 十 404 一 8 

64 

1 十 42 十 9W3 十 164 三 本 


1 十 8wu2 十 27UW3 十 _ 644 三 04 


1024 
1 十 lj6w2 十 8l3 十 236w4 三 一 


Establish the relation B(J) = (165(J) 8 1L)/16forthe case y =2. Use the 
following information: 


2 
SbD = 本 (ja 十 4 户 十 帮 ) 


and 


疡 
S(2) = 了 3( 思 十 4 万 十 2 户 十 4 户 十 及)， 


。9imDpDSOn'S Tujle， Consider the trapezoidal rules over the closed interval [xo, x3]: 


7(A37) = (3H11/2)( 思 十 方 ) with step size 31. and7( 有 = (PR/2)( 刀 十 2 广 十 
2 户 十 方 ) with step size 关 . Show that the linear combination (97 (六 1 了 (六 38))18 
produces Simpson's- 半 rule. 


7.。 Use equations (25) and (26) to establish equation (27)， 
8. Use equations (28) and (29) to establish equation (30). 
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9，Determine the Smallest integer 玉 for which 


人) 后 8x7dx = 256=R( 扩 ,天 ). 
(有 尼 1lxzl0dxz =2048= R( 开 ,天 )、 


10， Romberg integration was used to approximate the integrals 人 万 VXFdxz and (这 


1L. 


及 212 dt, and the results are given in the following table: 





Approximations for (i) 


R(0, 0) = 0.5000000 
RD 一 0.6380712 
R(2,2) 一 0.6577560 
R(3, 3) 一 0.6636076 
R(4, 4) 一 0.665$929 


Approximations for (ii) 


R(0, 0) = 1.0000000 
R(L D = 0.6666667 
R(2,2) = 0.6666667 
R(3, 3) = 0.6666667 
R(4, 4) 一 0.6666667 

















(a) Use the change of variable x 一 12 and dx = 21di and show that the two 
integrals have the Same numerical value， 

(Discuss why convergence of the Romberg sequence is slower for integral (ii and 
faster for integral ( 训 )， 

有 Rompers intcsration based on the midpoint rule The composite midpoint rule is 

competitive with the composite trapezoidal rule with respect to efficiency and the 

Speed of convergence. Use the following facts about the midpoint rule: 庆 (xx)dx 三 

M( 户 站 十 EMr( 广 间 . Therule MCA 站 andthe errorterm 尼 MP are given by 


AN 
MG 月 -Ar 人 (et 人 3 让)， Where = 





and 


EM( 记 由 一 alp2 十 a2814 十 a386 十 


4 Q 十 
”2 2 广 


Develop the sequential midpoint rule for computing 


MD) = MAN) 一 筷 / ( + ( 5 六) 


0 

27 

(bj Show how the sequential midpoint rule can be used in Place of the sequential 
trapezoidal rule in Romberg integration. 


(3) Start with 


hf(0) 











Where 有 7 一 
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Algorithms and Programs 





1、Use Program 7.4 to approximate the definite integrals in Exercise 1 with an accuracy 
of 11 decimal places. 


2. Use Program 7.4 to approximate the following two definite integrals with an accuracy 
of 10 decimal places，The exact value of each definite integral is 并 Explain any 
apparent differences in the rates of convergence of the two Romberg sequences. 


2 1 
(9) 人/ V4xr  X2dx (Db) 一 -7 
0 0 工 十 关 


3. The normal probability density function is Fo) = (1/V 玩 )e 忆 2, and the cumula- 
tive distribution is a function defined by the integral 中 人) 一 十 疡 有 e 0124 
Compute values for 中 (0.3), @(1.0), 中 (1.3), 02.0), 02.3), 中 (3.0),，@(3.5)，and 
中 (4.0) that have eight digits of accuracy， 


4. Modify Program 7.3 so that it will stop when consecutive valuesT(K 1l)and7(K) 
for the sequential trapezoidal rule differ by lessthan 5 x 10 6， 


Qx 


S. Modify Program 7.3 so that it will also compute values for the sequential Simpson 
and Boole rules. 


6. Modify Program 7.4 so that it uses the sequential midpoint rule to perform Romberg 
integration (use the results of Exercise 11)， Use your program to approximate the 
following integrals with an accuracy of 10 decimal places， 


1 。; 1 
(9 人/ smeooD wx () 1/ vVT idx 
1 


基 





7. Im Program 7.4 the approximations to a given definite integral are stored on the main 
diagonal of a lower-triangular matrix，Modify Program 7.4 so that tne rows of the 
Romberg integration tableau are sequentially computed and stored in a xl matrix R; 
hence it saves Space. Test your program on the integrals in Exercise 1. 


Adaptive Quadrature 


The composite quadrature rules necessitate the use of equally spaced points, Typically， 
asSmall step size 户 was used uniformly across the entire interval of integration to ensuie 
the overall accuracy，This does not take into account that some portions of the curve 
may have large functional variations that require more attention than other portions of 
the curve. It is useful to introduce a method that adjusts the step size to be smaller 
Over portions of the curve where a larger functional variation occurs. This technique is 
called adapizyre quadratxre. The method is based on Simpson's rule. 
Simpson's rule uses two Subintervals over [ak p]: 


玉 
( 力 S(Qt, pf) 一 了 Wet) 士 4/cb 十 76))， 


和 轿 可 上 Lp 
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Where ck 一 孝 (ak 十 pk) is the center of [wk, 外] and 三 (以 ab/2. Furthermore, 让 
太 e C4[ak, pthen there exists a value dl e [ak, pr] sothat 
- 其 (4) 好 
O) 1 JoDdr= sup 大 人 
三 90 
Refinement 


A composite Simpson rule using four subintervals of [ak, 内 ] can be performed by 
bisecting this interval into two equal subintervals [akl ,pr1] and [ak2, pk2] and applying 
formula (1) tfecursively over each piece. Only two additional evaluations of F(x) are 
needed, and the result is 


瑚 
S(akl pk1) 十 8S(ak2, pi2) 一 EC tl) 十 48(ctl 十 了 CD) 
(3) 


玉 
十 5CCp) 十 4(ck2) 十 了 (pz2))， 


Where dkl 一 Qk, pk1 一 ak2 一 ck pi2 一 bcklis the midpoint of [akl, pl], and ck2 is 
the midpoint of fak2, pk2]. In formula (3) the step size is 关 /2, which accounts for the 
factorsP/6 on the right side of the equation. Furthermore,if < C4[a, pb],there exists 
avalue de [w, 由] so that 


1 1) 
16 90 





卫 
Gd 上 JoDaz = SauyaD+Saeypo) 
CE 


Assume that 矿 (di) 之 丰 (do then the right sides of equations (2) and (4) are 
used to obtain the relation 


15 了 (GD) 及 /0) 
90 


(3) (ak ph) 这 一 590 





AS(ak PK1) 十 S(ak2，P12) 


which can be written as 


(0(d) 16 
了 5 汪 语 (C3Ckt pt) 十 St2, pe) Soc bo) 


Then (0) ls substituted lin (4) to obtain the error estimate:， 


(6) 有 5 








拓 
1 JJ)dx SCakl ki) SCakb2, pk2) 
(7) 全 


1 
科 五 1$(aktb pkD 十 SCakt2, pk2) (ak por)|， 


Because of the assumption 1 (di) s 4(d2),the fraction 十 is replaced with 凋 on 
the right side of (7) when implementing the method. This justifies the following test， 
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Accuracy Test 


Assume that the tolerance ek > 0is specified for the interval [ak, D6]. 开 
| - 
(8) 厅 1S(akl, PK1) 十 S(ak2 pk2) SCak, pr| < Ek， 


we infer that 


(9) 





中 
/ JJ)GE St MD SCak2, 大) < 如. 
CEK 


Thus the composite Simpson rule (3) is used to approximate the integral 


天 
(10) 1/ JoD ax s Sa ,pa 二 Sepo)， 
OK 


and the error bound for this approximation over [ak, pkj is 6k. 

Adaptive quadrature is implemented by applying Simpson's rules (1) and (3). Start 
with {[ao, bp0], ecoj，where eco is the tolerance for numerical quadrature over fao, po0]. 
The interval is refined into subintervals ljapbpeled [aol, po1] and [aoz, poz]. If the accu- 
racy test (8) is passed, quadrature formula (3) is applied to [cao, po] and we are done. If 
the test in (8) fails, the two subintervals are relabeled [al , 思 1 and [az, p2], over which 
We Use the tolerances El 三 Jeo and <c2 一 和 e0， respectively，、Thus we have two ii- 
tervals with their associated tolerances to consider for further Teftnement and testing: 
{[al, pi, sl] and {[a2z, 82],ez}, where el 十 e2 = ec0. If adaptive quadrature must be 
continued, the smaller intervals must be refined and tested, each with its own assocjated 
tolerance. 

In the second step we first consider {[al, bl], el] and refine the interval fal, po] into 
[all, pl1] and [al2, pl12]. 入 they Pass the accuracy test (8) with the tolerance el, quadra- 
ture formula (3) is applied to [al, p1] and accuracy has been achieved overthis interval. 
HIthey fail the test in (8) with the tolerance el, each subinterval [all, 5p11] and [ai2, 512?] 
must be refined and tested in the third step with the reduced tolerance 和 1. Moreover， 
the second step involves looking at {[cz, p2],ezj and refining [az, 52] into [azl, p21] 
and [az2, p22]. 于 they pass the accuracy test (8) with tolerance ez, quadrature formula 
(3) is applied to [az, p2] and accuracy is achieved over this interval. If they fail the test 
in (8) with the tolerance cz, each subinterval [azl, p21] and [fazz, pz2?] must be reftined 
and tested in the third step with the reduced tolerance je2. Therefore, the Second step 
produces either three or four intervals, which we relabel consecutively. The three inter- 
vals would be Ielabeled to produce {{[cl, Di], el {lcz, bp2],ez} fc3, 53], cj whbere 
cl 十 6 十 6 三 60. Inthe case of four intervals，we would obtain {{[al, 5], el)}， 
{[a2, 22], ez], {[a3, 03], eaj, {[c4, p4],e4jj, where el 十 ez 十 ea 十 @4 = 60. 

HI adaptive quadrature must be continued, the smaller intervals mnust be tested， 
each with its Own associated tolerance，The error term in (4) shows that each time a 
refinement is made over a smalier Subinterval there is a reduction of error by about 
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Table 7.8 ” Adaptive Quadrature Computations for fx) = 13(x xzx2)e 3772 








































Error bound on Tolerance 姑 
及 S(akl, pk) 十 9(ak2 ,了 2) the left side of (8) for [K, 中] 

. 0.02287184840 0.00000001522 0.00000015625 
0.0625 0.05948686456 0.00000001316 0.00000015625 
0.125 0.08434213630 0.00000001137 0.00000015625 
0.1875 0.09969871S32 0.00000000981 0.00000015625 
0.25 0.21672136781 0.0000002505S5 0.0000003125 
0.375 0.20646391592 0.00000018402 0.0000003125 
0.5 0.171S0617231 0.00000013381 0.0000003125 
0.625 0.12433363793 0.00000009611 0.0000003125 
0.75 0.07324S15141 0.00000006799 0.0000003125 
0.875 0.02352883215 0.00000004718 0.0000003125 
1.0 0.02166038952 0.00000003192 0.0000003125S 
1.125 0.06065079384 0.00000002084 0.0000003125S 
]1.25 0.21080823822 0.00000031714 0.000000625 
1.5 0.60550965007 0.00000003195 0.00000125 
2.0 0.31985720175 0.00000008106 0.000000625 
2.25 0.30061749228 0.00000008301 0.000000625 
2.5 0.27009962412 0.00000007071 0.000000625 
2.75 0.23474721177 0.00000005447 0.000000625 
3.0 0.36389799695 0.00000103699 0.00000125 
3.S 0.24313827772 0.00000041708 0.00000125 





1.34878823413 0.00000296809 


a factor of 击 . Thbus the process will terminate after a finite number of steps，The 
bookkeeping for implementing the method includes a sentinel variable which indicates 
让 a particular subinterval has passed its accuracy test, To avoid unnecessary additional 
evaluations of F(x), the function values can be included in a data list corresponding to 
each subinterval, The details are shown in Program 7.6. 


Example 7.16. Use adaptive quadrature to numerically approximate the value of the 
definite integral 万 13(C xx2)e 37/2dx with the starting tolerance co 二 0.00001. 

Implementation of the method revealed that 20 subintervals are needed. Table 7.8 lists 
each interval [ak, pf], composite Simpson rule S(akt, 欠 1) 十 8(akta, bi),theerrorboundfor 
this approximation, and the associated tolerance ek. The approximate value ofthe integral 
is obtained by summing the Simpson rule approximations to get 


4 
(1 人/ 13(x xx2)e 3z/2dx s% 1.54878823413. 
0 
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一 1.3 - 


Figure 7.9 The subintervals of [0, 4] used in adaptive 
quadrature. 


The true value of the integral is 


4 4108e 6 5S2 
1 130 xx2)e 3x/2dr 一 一 
0 27 


一 1.3487883723279481333， 


(12) 


Therefore, the error for adaptive quadrature is 
(13) | 1.94878837233 〈( 1.$4878823413)| = 0.00000013840， 


which is smaller than the specified tolerance eo = 0.00001. The adaptive method involves 
20 Subintervals of [0, 4], and 81 function evaluations were used, Figure 7.9 shows the graph 
of y = jx) and these 20 subintervals. The intervals are smaller where a larger functional 
Variation oOccuts near the origin. 

In the reftnement and testing process in the adaptive method, the first four intervals 
were bisected into eight Subintervals of width 0.0312S. If this uniform spacing is contin- 
ued throughout the interval [0, 4]，M = 128 subintervajls are Tequired for the composite 
Simpson rule, which yields the approximation ”1.34878844029, which is in error by the 
amount 0.00000006776. Although the composite Simpson method contains half the error 
of the adaptive quadrature method, 176 more function evaluations are required. This gain 


of accuracy is negligible; hence there is a considerable saving of computing effort with the 
adaptive method. 国 


Program 7.5, srule, is a modification of Simpson's rule from Section 7.1，The 
output is a vector Z that contains the results of Simpson's rule on the interval [a0, 50]. 
Program 7.6 calls srule as a Subronuitine to carry out Simpson's rule on each of the 
Subintervals generated by the adaptive quadrature process. 


SEC.7.4 ADAPTIVE QUADRATURE 387 


Program 7.5 (Simpson's Rule)，To approximate the integral 


如 及 
1 ， jc) dx 和 了 (1 (a0) 十 4Fc0) 十 帮 D0)) 


by using Simpson's rule, where c0 一 (a0 十 20)/12. 





function Z=srule(f ,a0,b0,tol0) 


%Input -1 is the integrand input as 3 String ?2 了， 
4 -~ a0 and b0 are UpPPer and Lower 1Limits of integration 
作 - to10 is the tolerance 


% output - Z is a lx6 Vector [a0 b0 S S2 erT tol1] 
h=(b0-a0)7V2; 

C=Zzeros (1 ,3) ; 

C=feval(f ,[a0 (a0+b0)/2 b0] ) ; 

S=hx (C(1)+4*C(2)+C(3))V3 

S2=S ; 

tolLt=tol0 ; 

er=tol0 ; 

Z=[a0 b0 S S2 erTr tol1] ; 


Program 7.6 produces a matrix SRmat, quad (adaptive quadrature appProximation 
to definite integrab and err (the error bound for the approximation)，The rows of 
SRmat consist of the end points, the Simpson's rule approximation, and the error bound 
on each subinterval generated by the adaptive quadrature process. 











Program 7.6 (Adaptive Quadrature Using Simpson's Rule)， To approximate 
the integral 


本 af 

1/ Je)dxzs》(CFd4k 4) 十 4x4k 3) 十 2jx4k 2) 
C 天 三 1 

十 4FCx4k 1) 十 了 (xc4b)). 

The composite Simpson rule is applied to the 4M subintervals [x4k 4,X44]，wWhere 


[a,b] = [xo,x4M] and xd4k 4H1 三 X4k 4 十 jhkforeach 大 三 1.. Mandy =1， 
.4. 


function [SRmat ,quad,err]=adapt (f,ayb,tol) 


XInput - f is the integrand input as a String )f， 

入 - a and b are upper and lower limits of :integration 
名 ~ tol is the 上 tolerance 

XDOutput ~ SRmat is the table of values 

久 - quad is the quadrature Value 


沁 - erTr zs the error egstimate 
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%Initialize values 
SRmat = Zeros(30,6) ; 
iterating=O0i 
done=1; 
SRvec=zero8s(1,6) ; 
SRvec=srule(f,a,b,tol); 
SRmat (1,1:6)=SRvec; 
m=1; 
State=iterating; 
while(state==iteratingy) 
D=m; 
for j=n3:-1:1 
P=j ; 
SROvec=SRmat (P，:); 
erIT=SROvec(5) ; 
tol=SROvec(6) ; 
if (tol<=err) 
4hBisect interVval ,apply Simpson)s rule 
hrecursiVvely，and determine error 
state=done ; 
SRlvec=SROvec ; 
SR2vec=SROvec ; 
a=SROvec(1) ; 
b=SROvec(2) ; 
cC=(a+b)V/2; 
erIT=SROVvec(5) ; 
to1l1=SROvec(6) ; 
to12=to1/2; 
SR1vec=srule(f,ac,tol2) ; 
SR2vec=srule(f,c,b,to12) ; 
erT=abs(SROvec(3)-SR1vec(3)-SR2vec(3) )/10; 
MAccuracy test 
if (err<tol) 
SRmat (p , : )=SROvec ; 
SRmat (p ,4)=SRlivec(3)+SR2vec(3) ; 
SRmat (P ,5)=erT; 
el1Se 
SRmat (p+1:m+1l, :)=SRmat(p:m,:); 
ZI=m+1 ， 
SRmat (P, :)=SRivec; 
SRmat (P+1, : )=SR2vec ; 
state=iterating; 
end 


SECc.7.5 GAUSS-LEGENDRE INTEGRATION (OPTIONAL) 389 


end 
end 
end 


quad=sum(SRmat(: ,4)) ; 
erzr=sumn(abs(SRmat(:,5))); 
SRmat=SRmat(1:m,1:6) ; 


Algorithms and Programs 





1. Use Program 7.6 to approximate the value of the definite integral，Use the Starting 
tolerance eo 一 0.00001. 





3 sin(2x) 3 . 。 1 1 
(9) 人 本 必 (D) 人 sin(4xje 2dxz  (g 人 本 未 上 
2 2 2 
(d T dx (e) 1/ mm(-) dx (人 (f 1 V4x  X2dx 
0 X2 十 1 LA(Cz) 并 0 


2。For each of the definite integrals in Problem 1 construct a graph analogous to Fig- 
ure 7.9， 瑟 nt The first column of SRmat contains the end points (except for 
of the subintervals from the adaptive quadrature process，If T=SRmat (: ,1) and 
Z=zeros(length(T) ) ,then plot(T,Z,:.:) will produce the Subintervals (ex- 
cept for the right end point 六 ). 


3. Modify Program 7.6 so that Boole's rule js used in each subinterval [fak, 站 ]. 


4. Use the modified program in Problem 3 to compute approximations and construct 
graphs analogous to Figure 7.9 for the definite integrals in Problem 1. 


Gauss-Legendre Integration (Optional 
We wish to find the area underthe curve 
?三 /oh)， 1<x<1， 


What method gives the best answer if only two function evaluations are to be made? 
We have already seen that the trapezoidal rule is a method for finding the area under 
the curve and that it uses two function evaluations at the end points ( 1, F( 1)),and 
(1 AbD). But 让 the graph of 》 = Co) is concave down, the error in approximation 
is the entire region that lies between the curve and the line segment joining the points 
(see Figure 7.10(a)). 

下 we can use nodes xl and xz2 that lie inside the interval [ 1, 1], the line through 
the two points (xl,，F(xzl)) and (xz2， 丰 (xz)) crosses the curve, andthe area underthe line 
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》 》 
?了 = 护 虽 
?了 = zx) 
郑 弟 
-1 0 1 一 ! 2 0 2 1 
(g) (人 


Figure 7.10  (a) Trapezoidal approximation using the abscissas ”1 and 1，(b) Trapezoidal 
approximation using the abscissas xl and xz2. 


Imore closely approximates the area underthe curve (See Figure 7.10(b)). The equation 
of the line is 


(4D y= JeD+ 开 20Ueo2) CD 


X2 XI1 
and the area of the trapezoid under the line is 


2x1 





2x 
O) Ap 一 二 Go) Co)， 


忆 1 


Notice that the trapezoidal rule is a Special case of (2), When we choose xl 一 1， 
x2 一 1,andj=2,then 


2 2 
7 间 == 77 CD) 本 Jo) = Je 十 三 (Cc2) . 


We shall use the method of undetermined coefficients to find the abscissas xl, xz? 
and weights 1, WwW2 so that the formula 


工 
G) 1 Daxzs weD+wyoal 


is exact for cubic polynomials (ie.，j(Cr) 一 a3X3 十 a2x2 十 alX 十 0)，Since four 
coefficients 1，UW2, xi, and X2 need to be determined in equation (3)，we can sejlect 
four conditions to be satished. Using the fact that integration is additive, it win suffice 


一 站 
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to require that (3) be exact for the four functions (xc) = 1, x, xx3. The four integral 
conditions are 


1 

xc) 王 1: 三- 加 
1 
1 

Je) 一 并 : 0 
1 

机 2 1 2 2 2 2 
Jr) 一 2 上 dz 二 可 二 WII 十 W272 


1 
oo = 妇 : 1 xz3dxz 一 0 一 Wixz 十 册 2z3. 
1 


Now solve the system of nonlinear equations 


(5) 1 十 由 一 2 

(0) 1X1 一 2X2 
2 

(7) ax 十 2x2 一 了 

(3) tx 一 2x3 


Wecan divide (8) by (6) and the result is 

(9) 好 一 了 Or  X4 一 j， 

Use (9) and divide (6) by xl on the left and > 阅 on the rightto get 
(10) U1 一 册 2， 

Substituting (10) into (S) results in Wi1 十 2 三 2. Hence 

(11) 1 一 WwW2 一 1. 


Now using (11) and (9) in (7), we write 


2 
(12) 12 十 222 一 2 十 好 = 了 OF 2 一 


Finally, ffom (12) and (9) we see that the nodes are 
2X1 一 22 二 1/31? 0.5773$02692. 


We have found the nodes and weights that make up the two-point Gauss-Legendre 
rule. Since the formula is exact for cubic equations, the error term will involve the 
fourth derivative. A discussion of the error term can be found in Reference [41]. 
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Theorem 7.8 (Gauss-Legendre Two-Point Rule)， HI 广 is continuous on [ 1 1， 
then 


13 厂 Cd =~cD=y/( 坊 )+7/( 方 ) 
(13) 7 X s CG2(P) 一 杞 万 几 


The Gauss-Legendre rule Ca2(. 门 has degree of precision 2 = 3. 和/ < C4[ 1, 1]， 
then 


1 1 1 
G4) / VCOdx=y ( 霹 ) + ( 亏 ) 二 BC， 
where 


Jec) 


(13) 及 ) = 玫 生 





Example 7.17. Use the two-point Gauss-Legendre rule to approximate 
1 dx 
一 -一 三 In(3) in() 交 1.09861 
/等 =me mo 


and compare the result with the trapezoidal rule 了 (jwith 疡 三 2 and Simpson's rule 
SCAP) withm = 1. 
Let C2 (站 ) denote the two-point Gauss-Legendre rule; then 


GC2(J) = 0.57735) 十 (0.37735) 
一 0.70291 十 0.38800 = 1.09091， 


了 (2 = 三 丰 1.00000) 十 F1.00000) 
= 1.00000 十 0.33333 = 1.33333， 


SCP 1) = 一 1.11111. 


f( D+4fOD+TFD 1+2 二 3 
一 一 = 一 一 
The errors are 0.00770， 0.23472, and ”0.01250, respectively, so the Gauss-Legendre 
rule is seen to be best，Notice that the Gauss-Legendre rule required only two function 
evaluations and Simpson's rule required three，In this example the size of the error for 
C2(J) is about 61% of the size of the error for S( 上 1 站). 蛋 


The general N-point Gauss-Legendre rule is exact for polynomial functions of 
degree <2N 1andthe numerical integration formula is 


(16) CN(j 站 ) = VN,IJCN1I 十 WwWN2CN2) 十 … 十 DDNNFCNN). 
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Table 7.9 ”Gauss-Legendre Abscissas and Weights 


1 N 
1/ | Jodx = 》 wkeN6+EN(C 
大 一 1 


0.3773502692 1.0000000000 
0.57735020692 1.0000000000 
士 0.7745966692 0.35$553555556 
0.0000000000 0.8888888888 









Truncation error, 


尼 N( 广 









1 人 
15,750 











土 0.8611363116 0.3478548451 Ge) 
士 0.3399810436 0.6521451549 3 075 



















士 0.9061798459 
土 0.3384693101 
0.0000000000 


0.2369268851 
0.4786286705 
0.5688888888 


F00(e) 
1.237,732,650 





















士 0.9324695142 0.1713244924 fd2(c)213(604 
士 0.6612093865 0.3607615730 (120313! 





士 0.2386191861 


士 0.9491079123 
土 0.74153118S6 
土 0.4058451514 
0.0000000000 


士 0.9602898565 
士 0.79666064774 
士 0.32S5324099 
士 0.1834346425 


0.4679139346 


0.1294849662 
0.2797053915 
0.3818300505 
0.4179591837 


0.1012285363 
0.2223810345 
0.31370664S9 
0.3626837834 

















Fa9 (c)215 (704 
(140)315! 



















F4d9 (cj217(80)4 
(160317! 





The abscijssas xN and weights WwWNk to be used have been tabulated and are easily 
available; Table 7.9 gives the values up to eight points. Also included in the table is 
the form of the error term NCA) that corresponds to CN( 门 , and it can be used to 
determine the accuracy of the Gauss-Legendre integration formula. 

The values in Table 7.9 in general have no easy rebresentation. This fact makes the 
method less attractive for humans to use when hand calculations are required. But once 
the values are stored in a computer it is easy to call them up when needed. The nodes 
are actually roots of the Legendre polynomials, and the corresponding weights must 
be obtained by sojlving a system of equations. For the three-point Gauss-Legendre rule 
the nodes are (0.6)12, 0, and (0.6)72, and the corresponding weights are 5/9, 8/9， 
and 5$/9. 
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Theorem 7.9 (Gauss-Legendre Three-point Rule)， It /is continuous on [ 1, 1]， 
then “ 


5 丰 人 V3/3+87OD+5ACV303) 


1 
07) 1 JaxwcaU)= 1 


The Gauss-Legendre rule G3() has degree of precision = S$. 玉 FeC5[ 1,1， 
then 


1 
0 站 ya= SO+57C 
1 





5 十 53( 万 )， 
where 
_ GO@) 
(19) E3(J) 三 15.750 


Example 7.18， Show that the three-point Gauss-Legendre rule is exact for 
1 
/ Sr4dx=2=G3( 有 . 
1 
Since the integrand is (xz) = Sx4 and f(O(x) = 0, we can use (19) to see that 
E3(P = 0. But it is instructive to use (17) and do the calculations in this case. 


5(5)(0.6)2 十 0 十 5(5)(0.6)? 18 
0 一 可 一 人, 国 


The next result shows how to change the varfiable of integration so that the Gauss- 
Legendre rules can be used on the interval [a, 六 ]. 


Ca3( 门 = 


Theorem 7.10 (Ihe Gauss-Legendre Translationm)。 Suppose that the abscissas 
{xzN 包 ， and weights { 也 NA are given for the N-point Gauss-Legendre rule over 
[ 1, 1]. To apply the rule over the interval [a, bp], use the change of variable 


_a+b 4 ba 




















(20) 1 一 一 + 一 and 省 = dx， 
Then the relationship 
1 D 7 
(21) 1/ FU -|/ 让 (到 + 一 “一 dr 
t 2 2 2 


is used to obtain the quadrature formula 


pa 嫌 QTpP PP a 
(22) 1 row= osr 人 (e+ 7 au) 
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Example 7.19、 Use the three-point Gauss-Legendre rule to approximate 


5 dr 
1 本 = 一 ln(9) ln(l) 之 1.609438 
1 


and compare the result with Boole's rule B(2) with 到 王 1. 
Herea=1landp=$,sotherule in (22) yields 


57(3 2(0.6)12] 二 8fG3 上 +0 二 5f03 十 2(0.6)12) 
9 
3.446359 十 2.666667 + 1.099096 


一 OO 一 人 一 1.002694. 


JIn Example 7.13 we Saw that Boole's rule gave BO2) = 1.617778.，The errors are 
0.006744 and ”0.008340, respectively, So that the Gauss-Legendre rule is slightly better 
in this case，Notice that the Gauss-Legendre rule requires three function evaluations and 
Boole's rule fequires five. In this example the size of the two errors is about the same.， 四 





Cas( 记 = (2) 


Gauss-Legendre integration formulas are extremejly accurate, and they should be 
considered seriously when many integrals of a similar nature are to be evaluated，In 
tbis case, proceed as follows. Pick a few reptesentative integrals, including some with 
the worst behavior that is likely to occur，Determine the number of sample points 
AN that is needed to obtain the required accuracy、Then fix the value N, and use the 
Gauss-Legendre rule with N sample points for all the integrals. 

For a given value of N, Program 7.7 requires that the abscissas and weights from 
Table 7.9 be saved in 1 x N matrices 4 and 全 ,respectively、，This can be done in 
the MAILAB command window or the matrices can be saved as M-files， It would 
be expedient to save Table 7.9in a 35 x 2 matrix G， The first column of GC would 
contain the abscissas and the second column the corresponding weights. Then, for a 
given value of N, the matrices 4 and 好 would be submatrices of G， For example, 计 
N 一 3,thenA=G(3:5,1)，andW=G(3:5,2) ). 








Program 7.7 (Gauss-Legendre Quadrature). To approximate the integral 
疡 六 
1 JODdxz 一》 UN 
4 2 大 一 1 


by sampling F(x) atthe N unequally spaced points {tvwkj 人 1 The changes of vari- 
able 





QQ 二 PP pp aa 忆 4 
I= 一 and 本 = 














are Used， The abscissas {xNkj 人 1 and the corresponding weights {wN,t]A_ must 
be obtained from a table of known values. 


function quad=gauss(f,a,b,Ai;W) 
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is the integrand jinput as a String : 工 ， 

and b are UPPer and lower limits of integration 
i8 the 1 XN vector of abscissag from Tab1le 7.9 
人 -Wis the1XxNYVvector of weights from Table 7.9 
YDutput - quad is the quadrature value 

N=length(A) ; 

T=zeros(1,N) ; 

T=((a+b)/2)+((b-a)V/2)*A; 

quad=((b-a)/2)*sum(W.*feval(f,T)) ; 


> 
1 
三 呈 且 中 


了 Exercises for Gauss-Legendre Integration (Optional) 


In Exercises 1 through 4, show that the two integrals are equivalent and calculate G2( 亡 ). 


2 1 2 1 
1. 1/ csd= 上/ 6( 十 D5dx 2. 1/ sod= |/ sin(x 十 1])dx 
0 1 0 1 


1 1 si 1 1 。 (x+1)218 
3 1 Sin(t) “=/ Sin((x 十 1/2) 四 4 1 人/ 212 有 1 1 / e ， 
0 上 1 X 十 1 V2r Ja V2r ji 2 


1 现 ， 1 _ 元 
5. 天 1/ cos(0.6sin())dr = 0.5 / ees (06sin (c 十 02)) dx 
6 


Use EN(P)in Table 7.9and the change of variable given in Theorem 7.10to find the 
Smallest integer N so that EN(P) 一 Ofor 
人 0 及 8xz7drz =256= GN( 四 ). 
(人 上 丘 1lxl0dxr =2048 = GN( 门 , 
7. Find the roots of the following Legendre polynomials and compare them with the 
abscissa in Table 7.9， 
(Ga) 到 (人 =(Gxz2 1D/2 
人 人) 杞 0 一 (Sx3 3z)/2 
(e@) 书 (z)=(3S$xz4 30x2 十 3)18 
8. The truncation error term for the two-point Gauss-Legendre rule on the closed in- 
terval [ 1, 1] is /4(cD/135，The tmuncation error for Simpson's rule on [&, 5] is 
及 4(cz)/90. Compare the truncation error terms when [ab = [ 1,1]. Which 
Imethod do you think is best? Why? 


9.、The three-point Gauss-Legendre rule is 


， 1 112 
六 7oms 王 9D+OT5O9 
1 


Show that the formula is exact for xz) = 1, xx2, X3, xz4, x5. Bin 于 广 is an odd 
名 nction (ie., jx) = JCx)) the integral of fover[ 1,1]is zero. 
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10. 


1 


12. 


The truncation error term for the three-point Gauss-Legendre rule on the interval 
[ 1 1 is Fo(c)/15, 750，The truncation error term for Boole's rule on [a, b] is 

817 fo(c2)/945. Compare the error terms when [fa, 妇 二 [ 1 1. Which method 
is better2 Why? 


Derive the three-point Gauss-Legendre rule using the following steps， Use the fact 
that the abscissas are the roots of the Legendre polynomial of degree 3. 


X1 一 (0.6)12， 和 ==0， 妆 =(0.6)12. 


Find the weights 1， WwW2，VW3 So that the relation 
1 
厂 7msm7( 0 人 +m7O+wm1ogI 
1 


is exact for the functions xz) = 1 x, andxz2 Hint First obtain, anid then solve the 
linear System of equations 


W1 十 W2 十 3 一 2 
(0.6)12uwl 十 (0.6)U2uwa = 0 
2 
0.6Ww1 十 0.63 一 了 
In Practice, 让 many integrals of a similar type are evaluated, a preliminary analysis js 
made to determine the number of function evaluations required to obtain the desired 


accuracy. Supposetihat 17 function evaluations are to be made. Compare the Romberg 
anSwer 尺 (4, 4) with the Gauss- Legendre answer CI17( 月. 


Algorithms and Programs 


1 


2. 


For each of the integrals in Exercises 1 through S,，use Program 7.7 to fnd G6(])， 
G7(,and Cg( 门 ， 


(a) Modify Program 7.7 so that it will compute Cl1(), G2 (及 , .,G8g(CP) and stop 
whben the relative error in the approximations CN 1(CF) andGCN(isless than 
the preassigned value tol, that is 


2IGN 1( 亡 GN( 门 | 
一 -一 一 一 一 一 一 <to1. 
IGNx 1C 站 +TCGNC 
Fnt As discussed at the end of the section, save Table 7.9 in an M-file G as a 
35 x 2 matrix CG. 


( 世 ， Use your program from part (3a) to approximate the integrals in Exercises 1 
through S with an accuracy of fve decimal places. 
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3. (a) Use the six-point Gauss-Legendre rule to approximate the solution of the inte- 
gral eduation 


3 
oO 一 m2+o1 人 (cz 十 半 uCD dt. 
0 


Substitute your approximate solution into the right-hand Side of the integral 
equation and simplify. 


(b) Repeat part (a) using an eight-point Gauss-Legendre rule. 





Numerical 
Optimization 


The two-dimensional wave equation is used in mechanical engineering to model vi- 
brations in rectangular Plates. If the Plates have all four edges clamped, the sinusoidal 
Vibrations are described with a double Fourier series. Suppose that at a _ certain instant 





Figure 8.1 (〈(a) The displacement z = (xx, y) of a vibrating plate. (b) The contour plot 
xy) 一 C forayvibrating plate. 
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of time the heightz 三 fx, y) overthe point (x, y) is given by the function 


zZ= jx,y)= 0.02sSin(x) sin(y) 0.03 sin(2x) sin(y) 
十 0.04 sin(x)Jsin(2y) 十 0.08 sin(2x) sin(2y). 
Where are the points of maximum deflection located? Looking at the three-dimen- 
Sional graph and the companion contour plot in Figure 8.1(a) and (bj, respectively, we 


See that there are two local minima and two local maxima over the square0 <x 莹 元 ， 
0<》<T.Numerical methods can be used to determine their approximate location: 


了 (0.8278, 2.3322) = 0.1200 and CQC.$351, 0.6298) 一 0.0264. 
are the local minima, and 
(0.9241, 0.7640) = 0.0998 ”and ”2.3979, 2.2287) 一 0.0853 


are the local maxima， 
In this chapter we give abrief introduction to some of the basic methods for locat- 
ing extrema of functions of one or Several variables， 


Minimization of a Function 


Defhnition 8.1 (Local Extremum)。、 The function is said to have a iocal jiaipzz7 
Palue atz 一 D, 示 there exists an open interval 7 containing p so that Fr(p) < (xz) for 
allx e7. Similarly, 广 is said to have alocalmaaxipzpumz yaiueatrz 一 pi < jP) 
foralx e7. I 了 haseither alocal minimum or maximum value atx 一 P,itis said 
to have a local ex1rem1zx71z atx 一 万 ， 全 


Definition 8.2 (Increasing and Decreasing). Assume that F(x) is defined on the 
interval 了 


GD Ifxzl < xz implies that FlxD < foo) forallzze7then rissaidtobe 
zacreasitg on 了 


GD Ixl1 < ximplies that Fox) > Cr2z) for all xl xz2 e 71, then 矿 is said to be 
decreasizig on 了. 公 
Theorem 8.1. Suppose that F (xz) is continuous on7 = [ac, 5] andis differentiable on 
(Q，D). 
GD 开 广 x)>0foralxre(c,D,then Fo is increasing on 7 
(i IF) <0foralxr e(a,p),then F(xz) is decreasing on 7. 


Theorem 8.2， Assume that F(xz) is deftined on 7 = [a, 中] and has a local extremum 
at an interior point P e (4, 站). If _F(x) is differentiable at x = p, then 六 (P) = 0. 
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Theorem 8.3 (First Derivative Tesb，Assume that 放 (x) is continuous on 7 一 [a, 有 ]. 
Furthermore, suppose that 广 (x) is defined for all x e (a, 5),exceptpossibly atx = 忆 . 


TD If Fo <0on(a,p)and Fexc) > 0on(p,p),then FFCp)is alocal minimum. 
(If Fo > 0on (a, p)and Foxz) <0on(p,p),then fp) is alocal maximum. 


Theorem 8.4 (Second Derivative Tesb0， Assume that 矿 is continuous on [C,p] and 
and AP" are defined on (a, 所 . Also, supposethat p es (a, p) is a critical point where 
太 p)=0. 
人 斑 Jp) > 0,then F(p) is alocal minimum of 矿 
(iD 开 J(p) < 0,then fp) is alocal maximum of 矿 
(iiD If .AP(p) = 0,then this test is inconclusive. 


Example 8.1， Use the second derivative test to classify the local extrema of 广 (x) 一 
x3 二 X2 十 1ontheinterval[ 2,2]. 

The first derivative is jx) = 3x2 十 2x 1 = (xx Jo +HD,andthe second 
derivative is (xz) = 6x 十 2. There aretwo points where F(x) =0(ie.,x = 1/3，1). 

Case (): Atx = 1/3 we find that F(1/3) = 0and (1/3) =4 > 0, sothat Fox) has 
alocal minimum atx 三 1/3. 

Case (ii Aty 一 wefndthatF( 1J)=0andj1 IDD)= 4<0sothat Fr) 
has a local maximumatx 一 工 . 四 


Search Method 


Another method for finding the minimum of xz) is to evaluate the function many 
times and search for a local minimum. To reduce the number of function evaluations， 
it js important to have a good strategy for determining where 让 (z) is eyaluated. One 
of the most efcient methods is cajled the gotder rafio searcP, which is named for the 
ratio's involvement in Selecting the points. 


The Gojiden Ratio 


Let the initial interval be [0, 1]. If0.S < < l,then0 <1 rr 一 0.Sandthe interval 
is divided into tbree Subintervals [0,1 门 , [1 mand fr,1]. A decision process 
is used to either squeeze from the right and get the new interval [0, >] or squeeze from 
the left and get [1 ”六 H. Then this new subinterval is divided into three subintervals 
in the same ratio as was [0, 1]. 

We want to choose r So that one of the old points wii be in the correct position 
with respect to the new interval as shown in Figure 8.2，This implies that the ratio 
(1 rr):rbethe same asr: 1. Hence rsatisfies the equation 1 7 = 六 which 
can be expressed as a quadratic equation r + 1 = 0. The solution r satisfying 
0.5<r <lisfoundtober 二 (v5 1) 12. 

.To use the golden search for finding the minimurm of (xz)，a special condition 
mnust be met to ensure that there is a proper minimum in the interval. 
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0 1] 一 六 户 1 0 一 > 广 工 
FE 一 二 了 四 一 二 | -7 
产 1 一 产 
FE 一 一 一 一 一 一 一 一 E 一 十 一 二 刁 
0 1 一 矿 1 一 太 1 
Squeeze from the right and Squeeze from the left and 
the new interval is [0, 7. the new interval is [1 -六 ]. 


Figure 8.2 TIhe intervals involved in the golden ratio search. 


>=o ?= 
G C 妈 已 Q C d 忆 
莹 Ac) 至 Ad) then squeeze IFd) < Ac) then squeeze 
from the right and use [a, dg from the left and use [c, 如 


Figure 8.3 The decision process for the golden ratio search. 


Defiinition 8.3 (Unimodal Function). The function f (xz) is unimodal on 7 = [a, 中 ]， 
让 there exists a unique number pe 7 such that 


(1) J (Cn) is decreasing on [a, p] 
(2) J (xz) is increasing on [P, 人]. 全 


开 Joo) is known to be unimodal on [ca, bp],it is possible to replace the interval with 
a Subinterval on which /xz) takes on its minimum value. The golden search Tequires 
that two interior points c 一 a 二 (1 rr) aandd 一 a+r(p al)beused where 
r is the golden ration mentioned above. This results in wa < c < d < 0. The condition 
that F(xz) is unimodal guarantees that the fanction values F(c) and F(d) are less than 
max{/(a),， DO)}， We have two cases to consjder (see Figure 8.3)， 

芷 yc) < ad),the minimum mustoccurinthe subinterval [a, d] and we replacep 
with d and continue the Search in the new subinterval. If Fd) < Fec),the minimum 
Imust occur in [c, 2，] and we replace a with c and continue the search. The nextexample 
compares the Tootrfnding method with the golden search method. 
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Table 8.1 Secant Method for 
Solving 六 (x) 一 2x cos() = 一 0 


















大 2P cos(CPk) 
0 0.0000000 1.00000000 
1 1.0000000 1.45969769 
2 0.4065540 0.10538092 
3 0.4465123 0.00893398 
4 0.4502137 0.00007329 
5$ 0.4501836 0.00000005 


Table 8.2 ”Golden Search for the Minimum of fox) 一 xz2 sin(x) 

































































































天 
0 0.3819660 | 0.6180340 1 0.22684748 0.19746793 
1 0.2360680 | 0.3819660 | 0.6180340 0.17815339 0.22684748 
2 0.3819660 |」 0.4721360 | 0.6180340 0.22684748 0.23187724 
3 | 0.3819660 | 0.4721360 | 0.5278640 | 0.6180340 0.23187724 0.22504882 
4 | 0.3819660 | 0.4376941 | 0.4721360 | 0.5278640 0.23227594 0.23187724 
5 | 0.3819660 | 0.4164079 | 0.4376941 0.4721360 0.23108238 0.23227594 
6 | 0.4164079 | 0.4376941 | 0.4508497 0.4721360 0.23227594 0.23246503 
21 | 0.4501574 | 0.4501730 | 0.45$01827 | 0.4501983 0.23246558 0.23246558 
22 | 0.4501730 | 0.4501827 | 0.4501886 | 0.4501983 0.23246558 0.23246558 
23 | 0.4501827 | 0.4501886 | 0.4501923 0.4501983 0.232465S8 0.23246558 





Example 8.2， Find the minimum ofthe unimodal function fx) = xsin(x) on [0, 1]， 

Solution by solving (xz) = 0. Aroot-finding method can be usedto determine where 
the derivative 六 (xz) = 2x cos(r) is zero. Since (0) = 1and FM(1 = 1.45$96977， 
aroot of 记 (x) lies in the interval [0, 1]. Starting with po 王 0and pl 一 1, Table 8.1 shows 
the iterations. 


The conclusion from applying the secant method is that 太 (0.4501836) = 0. The 
second derivative is 广 (Co) = 2 十 sin(z) and we compute (0.4501836) = 2.435131 > 0. 
Hence the minimum value is 六 0.4$01836) 一 0.2324656. 

Solution using the golden search. At each step, the fonction values Fc) and F(d) 
are comparedand a decision is made as to whetherto continue the search in [a, d] or fc, b]. 
Some of the compnutations are Shown in Table 8.2， 

At the twenty-third iteration the interval has been narrowed down to [az3, p23] 三 
[0.4501827, 0.4501983]. This interval has width 0.00001S$6. However the computed func- 
tion values at the end points agree to eight decimal places (ie.，F(a23) 富 ”0.232465S5$8 玉 
J(223)); hence the algorithm is terminated. A problem in using search methods is that the 
function may be flat near the minimum, and this limits the accuracy that can be obtained. 
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The secant method was able to fnd the more accurate answer p5 一 0.4S01836. 
Although the golden search is slower in this example, it has the desirable feature that 
it can be applied in cases where F(x) is not differentiable. 国 


Finding 也 xtreme Values of /xc , y 


Definition 8.1 is easily extended to functions of several variables. Suppose that F xz, y) 
is defined in the region 


(3) R={o7):C PP 二 (7 4) < 
The function jx,y) has alocal minimum at (p, g) provided that 


(4) Jp,9) < jc,y) foreach point (x, 7) e 玉 . 


The function /xz, y) has a local maximum at (P, g) provided that 
(9) Gy)< 0p,9q)  ， foreach point (xy) e R. 


The second derivative test for an extreme value is an extension of Theorem 8 .4. 


Theorem 8.5 (Second Derivative Tesb， Assume that 太 (x， y) and its first- and 
Second-order partial derivatives are continuous on a Tegion R. Suppose that (p,g) E 民 
is a critical point where both 户 (p,qg) 一 0and 万 (p,9) = 0. The higher-order Partial 
derivatives are used to determine the nature of the critical point. 


G 开户 r(p,9g) 放 (pq) (pg) > 0and Ar(p,9q) > 0,then Flp,q)isa 
local minimum of 矿 . 


罗 开 Ar(P,q)jor(p9) 入 (p,9g) > 0and 户 r(p,9) < 0,then fp,q)isa 
local maximum of 矿 . 


(Ga) 开 .Arx(P,9) 记 7(P,9) JP， 4) < 0, then 太 (x, y) does not not have a local 
extremum at (P, 9). 


Gv) I Ap,9) 记 7(P,9) Jo(P， 2) = 0, this test js inconclusive. 


Example 8.3. Find the minimum of fx,J) 一 xz2 4xz 十 2 》 xy 
The first-order partial derivatives are 


(0) xy)=2x 4 7 and Ah)=27 1 7 
Setting these partial derivatives equal to zero yields the linear system 


2xX yy 三 4 


7] 
人) X 十 27y 一 |. 
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The solution to (7) is (xy) 一 (3,2). The second-order partial derivatives of /xy) are 
.Arx(z,y) 三 2， yx， y) 一 2， and yc y) 一 1 


It is easy to see that we have case (i) of Theorem 8.5, that is 
rr(3,2). 记 7y(3,2) (3， 2)=3>0 and ArG,2)=2>0. 


Hence Fx, y) has a local minimum 3,2) = 7atthe point (3, 2)， 国 


The Neljder-Mead Method 


A simplex method for fnding a local minimum of a function of several variables has 
been devised by Nelder and Mead，For two variables, a simplex is a triangle, and 
the method is a pattern search that compares function values at the three vertices of a 
triangle. The worst vertex, where 丰 (x, y) is largest, is rejected and replaced with a new 
vertex. A_ new triangle is formed and the search is continued. The process generates 
a Sequence of triangles (which might have different shapes), for whbich the function 
values at the vertices get Smaller and smaller The size of the triangles is reduced and 
the coordinates of the minimum point are found. 

The algorithm is stated using the term simplex (a generalized triangle in N di- 
mensions) and will fnd the minimum of a function of N variables. It is effective and 
computationally compact. 


The Initial Triangle 刀 G 作 


Let fx, y) bethe function thatis to be minimized. To start we are given three vertices 
of a triangle: 纺 三 (COxk， ), 大 三 1,2,3. The function 放 (x, y) is then evaluated at each 
of the three points zk 三 (xck, 从) forK = 1 2, 3. The subscripts are then reordered so 
that z1 < z2 < 7Z3. We use the notation 


(8) 巨 王 CD)，， G=02y)， and 风 王 (3,)3) 
to help rememberthat 妃 is the best vertex, G is good (next to besb, and 压 is the worst 


Vertex. 


Midpoint of the Good Side 


The construction process uses the midpoint of the line segment joining 妃 and G . Itis 
found by averaging the coordinates: 


(9) 7 二 C _ 忆 十 浆 忆 十 六 
2 2 2 
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尺 
册 Figure 8.4 The triangle ABGWY 
and midpoint WM and reflected point 
C RR for the Nelder-Mead method. 
B 到 


G 


Figure 8.$S The triangle ABCGW and point 员 and extended point 互 . 


Reflection Using the Point 民 


The function decreases as we move along the side of the triangle from 全 to 媚 , and it 
decreases as We Immove along the Side from 现 to G. Hence it ls feasible that 太 x, y) 
takes on smajller values at points that lie away from 全 on the opposite side of the jne 
between 玉 and G. We choose atest point 民 that is obtained by “reflecting”" thbe triangle 
through the side BCG. To determine 玉 , we first fnd the midpoint M of the side 了 G. 
Then draw the line Segment from 人 砚 to M and call its length d. This last segment is 
extended a distance d through Mf to locate the point 尺 (see Figure 8.4). The vector 
formula for 丸 is 


(10) 及 =M+TOM 丽 )=2M 克 . 


Expansion Using the Point 兢 


Ifthe function value at 民 is smaller than the function value at 丈 ,then wehave moved 
in the correct direction toward the minimum. Perhaps the minimum is just a bit farther 
than the point 民 ，So we extend the line segment through M and 丸 to the point 五 . 
This forms an expanded triangle BGEE. The point 互 is found by moving an additional 
distance d along the line joining M and 丸 (see Figure 8.3). 革 the 名 nction value at 五 


SEC. 8.1 MINIMIZATION OF A FUNCTION 407 


Figure 8.6 The contraction point 
C Cl or C2 for Nelder-Mead method . 





Figure 8.7 ”Shrinking the triangle 
C toward 刀 . 


js less than the function value at 民 , then we have found a better vertex than 玉 . The 
vector formula for 五 is 


(1 已 = 有 +(R MI 一 2R 1 


Contraction Using the Point C 


下 the function values at 尺 and 刺 are the same, another point must be tested. Perhaps 
the fonction is smaller at M , but we cannot replace 厂 with M because we imust have 
atriangle. Consider the two midpoints Cl and C2> of the line segments 丈 17 and MMR 
respectively (see Figure 8.6). The point with the smaller function value is called C， 
and the new triangle i8 有 CC，Note: the choice between Cl and C2 might seem 
inappropriate for the two-dimensional case, but it is important in higher dimensions， 


Shrink toward 刀 


下 the function value at C is not less than the value at 全 ,the points G and 多 mustbe 
shrunk toward 刀 (see Figure 8.7). The point G is replaced with M, and 钱 is replaced 
with $, which is the midpoint of the line segment joining 妃 with 人 帮 . 
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Table 8.3 ”Logical Decisions for the NelderMead Algorithm 


IF FFCR) < FC), THEN Perform Case (i) {either reflect or extend} 
ELSE Perform Case (ii) {feither contract or shrink} 


BEGIN {Case 人 .} BEGIN {Case (这 .} 
IF F05) < _FCR) THEN IF FCR) < JOY)THEN 
replace 克 with 尺 L_ replace 页 with R 
ELSE Compute C 一 ( 风 十 M)/2 
orC=(M+R)/2and FC) 
Compute 天 and 广 (E) IF _FC) < FOOD) THEN 
IF FE) < J 了 (5)THEN tfeplace 网 with C 
replace 克 with 丈 ELSE 
ELSE Compute $ and /9) 
replace 风 with 尺 replace 内 with 
ENDIF replace CO with M 
ENDIEF ENDIF 
END {Case (.} ENPD {Case (这 


Logical Decisions for Each Step 


A computationally efficient algorithm should perform function evaluations only 让 
needed，In each step，a new vertex is found，which replaces 了 全. As soon as it is 
found, further investigation 1$ hot needed, and the iteration step ls completed. The 
logical details for two-dimensional cases are explained in Table 8.3. 


Example 8.4， Use the Nelder-Mead algorithm to fnd the minimum of Fox,y) = 2? 
4x 十 xy.Start with the three vertices 


Y1=(0.0)， YY =(1.2,0.0)， Ya3 = (0.0,.0.8). 
The function 广 (x, y) takes on the values 
J 0.0) = 0.0， 2.0.0) = 3.36， (0.0,.0.8) = 0.16. 
The function values must be compared to determine 中，G, and 全 ; 
=(1.2,0.0)， G=(0.0.0.8)， 厂 =(0,0). 
The vertex 研 = (0, 0) will be replaced. The points M and RR are 
到 十 G 





if = = (0.60,0.4) and 丸 =2M 凡 =(12,0.8)， 


The function value (CR) = /1.2,0.8) = 4.48 is less than FG), so the Situation is 
case (i, Since FRR) < 7(B), wehave moved in the right direction, and the vertex 五 must 
be constructed: 


五 王 2R M=2(1.2,0.8) (0.6,0.4) = (1.8, 1.2). 
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一 十 一 于 一 ~ 
1 2 3 


Figure 8.8 The sequence of triangles { 克 } converging to the point (3, 2) for the 
Nelder-Mead method. 


The function value FE) 三 /1.8, 1.2) = 3.88 is less than /BEB), and the new triangle 
has vertices 


Y1 = (1.8, 1.2)， YY2 = (1.2,0.0)， Y3 = (0.0,0.8). 


The process continues and generates asequence of triangles that converges down on the 
solution point (3, 2) (See Figure 8.8). Table 8.4 gives the function values at vertices of the 
triangle for Several steps in the iteration. A computer implementation of the algorithm con- 
tnued until the thirty-third step, where the best vertex was 男 = (2.99996456, 1.99983839) 
and 丰 (B) 王 ”6.99999998. These values are approximations to 让 3,2) = 7found in 
Example 8.3. The reason that the iteration quit before (3, 2) was obtained is that the func- 
tion is flat near the minimum. The fnction values 丰 (B)，F(G), and 太太 ) were checked 
and found to be the same (this is an example of round-off error), and the algorithm was 
terminated. 图 


Minimization Using Derivatives 


Suppose that (xz) is unimodal over [a, p] and has a unique minimum at x 一 忆 . Also， 
assume that 广 (xz) is defined at all points in (ca, 和 .Let the starting value po lie in 
(Q, D), 开 产 (po < 0,the minimum point p lies to the right of po. If 六 (po) > 0, p 
]ies to the left of po (see Figure 8.9). 
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Table 8.4 Function Values at Various Triangles for Example 8.4 


FL2,0.0)= 3.36 0.0,0.89)= 0.16 
8,1.2) 一 5.88 1.2,0.0) 一 3.36 
7(L8,1.2) = 5.88 0G3.0,0.4)= 4.44 
3.6, 1.60)= 6.24 .8,12)= 5.88 
(3.6,1.6) = 6.24 2.4,2.40) 王 6.24 
2.4,1.6)= 672 .6,1.60)= 624 
(3.0, 1.8) = 6.96 2.4,1.6)= 6.72 













Werst point 


0.0,0.0= 0.00 
0.0,0.8)= 0.16 
FL2,0.0)= 3.36 
J3.0,.0.0= 4.44 
1.8, 1.2)= 5.88 
2.4,2.0)= 6.24 
J2.4,2.4)= 6.24 



















已 忆 0 了 宁 一 


(3.0, 1.8) = 6.96 (2.33$, 2.053) 一 6.7725 (2.4, 1.6)= 6.72 
J(3.0, 1.8) = 6.96 J (3.15, 2.25) 一 6.9525 J (2.5$$, 2.05) = ”6.7725 
1 3.0, 1.8) = 6.96 | 2.8125, 2.0375) = ”0.95640625 | (3.1$, 2.25) = ”6.9525 











?了 = ?= 
E 一 一 一- -一 E 上 一 一 一 3 
克 Po0 也 六 G 忆 20 
Ito) < 0then IFpo) > 0then 
P lies in [po, 中， P lies in La, po]. 


Figure 8.9 Using (ce) to find the minimum value of the unimodal func- 
tion 丰 x) on the interval [G, D]. 


Bracketing the Minimum 
Our first task is to obtain three test values， 


(12) Po0， DPI=po 二 jn， and  Pp2=Ppo 十 21， 
so that 
(13) Jpo) > 让 (pDD and COpD < Fp2). 


Suppose that 广 (po) < 0; then po < 忆 and the step size 有 should be chosen positive. 
Lis an easy task to fnd a value for 疡 so that the three points in (12) satisfy (13). Start 
with 下 一 Tin formula (12) (provided thata 十 1 < 六 ). 


Case (人 人: 芝 (13) is satisfied, we are done. 


Case GD): 了 Jo > 7F(PD and F(pD > (pzj, then P2 < P，We need 
to check points that lie farther to the right， Double the step size and 
Tepeat the ProcessS. 
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Case (iii): If po) < FDih wehavejumped over p andP is too large, We need 
to check values closer to p0. Reduce the step Size by a factor of 3 and 
repeat the process. 


When 广 (po) > 0, thne step size 户 should be chosen negative and then cases similar 
to (iD to (iii) can be used. 


Quadratic Approximation to Find P 


Finally, we have three points (12) that satisfy (13). We will use quadratic interpolation 
to find pmin， which is an approximation to P. The Lagrange polynomial based on the 
nodes in (12) is 


区 区 基 大 区 大 
Gd ooo = ?0 吕 P2) 3 人 他 P2) 32 2 P1) 
The derivative of O(xz) is 
(5 oo = y0(C25x 5 P2) 。 yL(2X 将 忆 2) 二 2(2X 5 PD) 
Solving CCx) = 0inthe form Opo 十 Panin) 一 0yields 
0 ?CCo+Pnin) plL_ P) (Po 二 hm) 2p0 252) 
40 212 2j2 


十 y2(2(po 十 pmnin) Po PI) 
272 


Multiply each term in (16) by 2pn2 and collect terms involving Amin: 


Pin(2y0 471 十 272) 一 yo0(2po PPl  P2) 
y1(4pP0 2p0 2p2) 十 ?2(2p0 po DD 
一 ?0( 38) y( 41) 十 72( 六 ， 


This last quantity is easily solved for PPmin: 


ji(471 370 22) 
(17) join 二 一 2 一 0 22 
471 2y0 2y2 
The value pmin 三 po 十 Pmin is a better approximation to P than p0， Hence we 
can replace Po with pmin and ITepeat the two processes outlined above to determine a 


new 忆 and a new jnin. Continue the iteration until the desired accuracy is achieved. 
The details are outlined in Program 8.3. 
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Steepest Descent or Gradient Method 


Now jlet us turn to the minimization of a fonction (KE) of N variables, where 万 一 
(xl1,X2,...,XN). The gradient of (ET) is avector function defined as follows 


(18) grad 三 ) = (万 ， 户 .jh)， 


where the partial derivatives 大 = 0F/oxk are evaluated at 天. 

Recall that the gradient vector (18) points locally in the direction of the greatestrate 
of increase of F(X). Hence grad /于 ) points locally in the direction of the greatest 
decrease、Start at the point 忆 o and search along the line through Po in the direction 
So 三 C/1GCl where G = grad F(Po). You will arrive at a point 忆 1, where a local 
minimum occurs when the point Xis constrained to lie on the line 大 一 克 0 十 1S0. 

Next， we can compnute CG = grad F(P1) and move in the search direction Si == 

G/1Gl. You will cometo P2, where alocal minimum occurs when 三 is constrained 
to leonthelne 基 一 下 1 十 191. Iteration will produce a Sequence { 尼 tj of points with 
the property /Po) > JFCPIUD > … > Ph) > Ilimk eeRx=P,then 放 P) 
will be a local minimum for 三 ( 卫 ). 


Outiine of the Cradient Method 
Suppose that 忆 / has been obtained. 


9tep 7，Evaluate the gradient vector G 一 grad F( 尼 1). 

Step 2，Compute the Search direction S$ 三 CG/1GI|. 

9tep 了 Perform a single parameter minimization of 中 (0) 三 太 P 十 1S) on the 
interval [0, bj], where p is large. This will produce a value 上 一 Panin where 
alocal minimum for 中 (1) occurs. Therelation @(pnin) 到 (Pk 十 jninS) 
shows that this is a minimum for 三 ) along the search line 大 一 忆 十 
jnming， 

tep 4 Construct the next point 已 t+1 三 忆 十 PamninS， 

Step 5，Perform the termination test for minimization; that is, are the 名 nction val- 


ues 厂 (Pk) and PH sufficiently close andthe distance | Pzi 殊 人 | 
Small enough” 


Repeat the process. 











Program 8.1 (Golden Search for a Minimum)，To numerically approximate the 
minimum of 六 zx) on the interval [a, p] by using a golden search. Proceed with the 
method only ift fx) is a unimodal function on the interval fa, 2]. 


function[S,E,G]=goldenkf ,a,b,delta,epsilony) 


%hInput - 节 is the object function input as a string :f) 
久 - a and b are the end points of the interVal 
4 -~ delta is the tolerance for the abscissas 


， 
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为 -~ epsilon is the tolerance for the ordinateg ， 
khOutput -~- S=(P,yP) contains the abscissa P and 

欠 the ordinate yp of the minimum 

- E=(dp,dy) contains the error bounds for P and yp 

加 -Gais annxXx4matrix: the kth row contains 

共 [ak ck dk bk] ; the values of a，c，d，and b at the 
久 kth iteration 

rl=(sqrt(5)-1)7V2; 

T2=T1”2; 

h=b-a; 


ya=feval(f,a) ; 
yb=feval(f,b) ; 

C=3a+T2kh ; 

Q=a+T1kh ; 

yc=feval(f ,c) ; 

yd=feval(f ,d) ; 

K=1; 
A(k)=aiB(k)=b;iC(k)=c;D(Ck)=di 


while(abs(yb-ya)>epsilon) | (h>deltay) 
K=K+l ; 
if (yc<yd) 
b=d; 
yb=yd; 
Q=c ; 
yd=yc ; 
h=b-a; 
C=a+r2xkh ; 
yc=feval (f,c) ; 
else 


Q=a+Trlzxzhi; 
yd=feval(f ,d) ; 
end 
A(k)=ajiB(k)=b;C(K)=ciD(k)=di 
enda 
dp=abs (b-a) ; 
dy=abs(yb-ya) ; 
P=a， 
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yP=ya， 
if(yb<yay) 
P=b; 
ypP=yb ; 
end 
G=[A C， DB]; 
S= [P ypP] ; 
E= [dp dy] ; 


Programs 8.2 and 8.4 require that the object function f be Saved as an M-file. The 
argument of f needs to beal xmarray Toillustrate consider saving the function in 
Example 8.3 as an M-file: 
function Z=f(V) 

Z=0j Xx=V(1) ; Yy=V(2) ; 
Z=X. 2-4X+y，， 2-y-X. 冰 y ; 











Program 8.2 (Nelder-Mead's Minimization Methoq)， To approximate a local 
minimum of 帮 (xl1, x2,...,XYN)，whbere 太 is a continuous function of N real vari- 
ables, and given the N 十 1 initial starting points YX 三 (uk .uk N) for 有 = 0， 
1 ..，N. 





function[VO,y0,dV,dy]=nelder(F,V,min1,maxt,epsilon,show) 


%Input -了 is the object function input as a String :2PF， 
长 -Visa3xDnmatcriXx containing starting Simp1ex 
久 -~ 了 inl 女 maxl are minimum and maximun number 
六 of iterations 
久 - epsilon s the tolerance 
% - Show == 1 displays iterations (P and Q) 
hkOutput ~ V0O is the Vertex for the minimum 
- y0 is the function value F(VO) 
六 -~ dV is the size of the final simplex 
人 ~ dy is the error bound for the minimnum 
欠 -~ P is a matrix containing the Vertex iterations 
所 ~ Qis an array containing the iterations for F(P) 
It nargin==5， 
Show=0; 
end 


[mm n]=size(V) ; 
% Drder the vertices 
for j=1:n+l1 
2Z=V(j ,1:D) ; 
Y(j)=feval(F ,Z) ; 
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end 


[mm 1o]=min(Y) ; 
[mm bi]=max(Y) ; 
1i=hjiy; 
ho=1o; 
for ]j=l1:n+l 
if(j~=1ogj~=hig&Yy(j)<=Y(Li)) 
1i=j; 
endQ 
if(j~=higj~=1ogY(j)>=Y(ho)) 
bo=j ; 
end 
end 


Cnt=0 ; 


% Start of Nelder-Mead algorithm 
while(Y(hi)>Y(1o)+epsilongcnt<max1) | cnt<minl 
S=zeros (1 ,1:n) ; 
for j=1:n+1 
S=S+V(j ,1:D) ; 
end 
M=(S-V(hi ,1:n))/n; 
R=2*M-V(hi,1t:n); 
yR=feval(F,R) ; 
itf(yR<YCho) ) 
if(Y(Li)<yR) 
VChi,1l:n)=R; 
Y(hi)=yRi 
el18e 
E=2*R-M; 
yE=feval(F ,E) ; 
if(yE<Y(1i)) 
V(hi,1:n)=E; 
Y(hi)=yE; 
elSse 
VChi,1l:n)=R; 
Y(hi)=yR; 
endQ 
end 
elLSe 
if (yR<Y(hiy)) 
VChi ,1:n)=R; 
Y(hi)=yR; 


415 
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endQ 
C=(V(hi ,1:n)+M)V2; 
yC=feval(F ,C) ; 
C2=(M+R)V2; 
yC2=fevalL(F,C2) ; 
if(yC2<yC) 
C=C2; 
yC=yC2 ; 
end 
if(yC<Y(hi)) 
VGhi ,ii:n)=C; 
Y(hi)=yC; 
ese 
for j=1:n+l 
计 (j~=1o0) 
V(j ,1:n)=(V(j ,1:n)+V(Lo,1:n))/2; 
2Z=V(j ,1:n) ; 
Y(j)=feval(F,Z) ; 
end 
end 
ena 
end 
[mm lo]=min(Y) ; 
[mm hi]=max(Y) ; 
1i=hi; 
bo=1o ; 
for j=1:n+1 
if(j 人 =1ogj~=hig&Y(j)<=Y(1i)) 
1i=j; 
enda 
if (j 人 =higj~=1o&Y(j)>=Y(ho) ) 
ho=j ; 
end 
end 
cnmnt=Cnt+l ; 
P(Ccnt ,:)=V(1o，,:); 
Q(Ccnt)=Y(LIo) ; 
end 
% End of Nelder-Mead algorithm 


XDetarmine size of simplex 

SDOITm=0 ; 

for j=1:nt+l 
SsS=norm(V(j)-V(Lo) ) ; 
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if(s>=SDnorm) 
SDorm=s ; 
end 
end 
Q=Q 7 ; 
VO=V(Llo ,1:n) ; 
yO=Y(1o) ; 
dV=SDorm; 
dy=abs(Y(hi)-Y(1o) ) ; 
if (show==1) 
disPp(P) ; 
disp(《Q) ; 
end 


Program 8.3 (Local Minimum Search Using Quadratic Interpolation). To find 
a local minimum of the function F(xz) over the interval [Q, 站 ], by starting with one 


initial approximation po and then searching the intervals [C, po] and [po, 5]. 





function[p,yp,dp,dy,P]=quadmin(f,a,b,delta,epsilon) 


%Input - f is the object function input as a String 'f， 
AN 扩 -~ a and b are the end points of the interVal 
区 -~ delta is the tolerance for the abscissas 

六 -~ epslilon is the tolerance for the ordinates 
%Output - P is the abscissa of the minimum 

久 - yp is the ordinate of the minimum 

六 - dp is the error bound for P 

-~ dy is the error bound for ypP 

4 - P is the Vector of iterationgs 

P0=a; 

maxj=20 ; 

芯 aXK=30 ; 

big=1le6 ; 

erIT=]; 

K=1 ; 

P(k)=p0 

ConQ=0 ; 

hbh=|; 


if (abs(P0)>1le4) ,h=abs(P0)/V1e4;end 
While(k<maxkgerr>epsiLonk&cond~=5) 
fl=(feval(f,p0+0.00001)-feval(f ,pO0-0.00001))V0. oo0oo2， 
if(flt>0) ,h=-abs(h) ;end - 
Pl=pPO+h ; 
P2=PO+2x#h ; 
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Pain=POi 
y0=feval(f ,p0) ; 
yl=feval(f ,plt) ; 
y2=feval(f,p2) ; 
ymin=y0 
Cond=0 ; 
j=0; 
YDetermine h so that yl<yO&Yy1<y2 
while(j<maxjg&abs (h)>deltagcond==0) 
if (y0<=y1) ， 
P2=Pi; 
7y2=y1 ; 
h=h/2; 
P1=PO+hi 
yl=feval(f,p1); 
elLSe 
if(y2<y1) ， 
P1=p2; 
7y1=y2; 
h=2xh; 
P2=pO+2+h ; 
y2=feval(f ,p2) ; 
else 
Condq=-1; 
end 
end 
j-j+dli 
if (abs (h)>biglabs(P0)>big) ,cond=5;end 
end 
if(cond==5) ， 
Pmin=pi; 
ymin=feval(f ,pl); 
el1Se 
XQuadratic interpolation to find yp 
d=4*+*y1-2+y0-2*y2 ; 
if(dq<0) ， 
hmin=h* (4+y1-3*yO0-~y2)V/d; 
el1Sse 
hmin=h/3; 
Cond=4; 
end 
Pmin=pO+hmin; 
ymin=feval (于 ,pmin) ; 
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h=abs(h) ; 

ho=abs (hmin) ; 
hli=abs(hmin-h) ; 
h2=abs(hmin-2*xh) ; 


YXDetermine magnitude of next h 

if(h0<h) ,h=h0;end 

if (hl<h) ,hn=h1liend 

if(h2<h) ,h=h2;end 

if (hn==0) ,h=hminiend 

if(h<delta) ,cond=1;end 

if (abs(h)>biglabs(pmin)>big) ,cond=5;end 


YXTermination test for minimization 
e0=abs(y0-ymin) ; 
el=abs(y1-ymin) ; 
e2=abs(y2-yminy) ; 
if(e0~=0 娘 e0<err) ,err=e0;end 
it(el~=0 名 el<err) ,err=edliend 
if(e2~=0 & 2<erTr) ,err=e2;end 
if(e0~=0 & el==0 & e2==0) ,error=0;end 
itf(err<epsilon) ,cond=2;end 
PO=pmin ; 
X=KX+1 ; 
P(K)=p0O; 
end 
if(cond==2kh<delta) ,cond=3;end 
end 
P=P0; 
dp=h; 
yp=feval(f,p) ; 
Qy=eIrI; 


Program 8.4 requires that the object function f be saved as an M-file. Additionally， 
the search direction ”grad jlgrad 让 | needs to be saved as an Mr-file. To illustrate， 
consider the function 太 from Example 8.3, where the gradientof fis (2x 4 2y 
1 2). An appropriate M-file for this particular fonction 矿 is 


function z=G(V) 
Zz=Zeros(1,2) ; 
x=V(1) ;7y=V(2) ; 
g=f2x-4-y 2*y-1-X] ; 
Z=-(1/norm(g) )*g; 
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Program 8.4 (Steepest Descent or Gradient Method)，To numerically approxi- 
mate alocal minimum of 三 X), where 太 is a continuous function of N real variables 


and 瑟 一 (xlx2,...,XN)， by starting with one point Po and using the gradient 
method. 





function[PO,y0,err]=grads(F,G,P0,maxl,delta,epsilon,show) 


%Input -了 is the object function input as a StTing ?FEF， 
4% - G =-(1/norm(grad F))*grad F; the search direction 
久 input as 3a StTring 2?G， 

- P0 is the initial starting point 

类 - maxl Is the maximumn number of iterations 

六 - delta is the tolerance for hmin in the single 
办 Parameter minimization in the Search direction 
多 - epsilon is the tolerance for the erIror in y0 

久 -~ Show; if Show==l the iterations are displayed 
YXDutput - P0 is the Point for the minimum 

人 - y0 is the function Value F(P0) 

六 - erT is the error bound for y0 

共 -~ P is a Vector containing the iterations 


if nargin==5 ,Show=0;end 
[mm n]=]jsize(PO0) ; 
maxj=10; big=1e8; h=1; 
P=zeros (maxj ,n+1) ; 
1en=norm(PO0) ; 
yO=feval (F,P0) ; 
if (len>e4) ,h=len/te4;end 
erTr=1li;cnt=0;cond=0; 
P(cnt+l,，:)=[PO yO0] ; 
while(cnt<maxl&cond~=5& (hb>deltalerr>epsilon)) 
YXCompute search direction 
S=feval(G,P0O) ; 
phStart single Parameter quadratic minimization 
P1=PO+h*rS ; 
P2=PO+2*hS; 
ylL=feval(F,P1) ; 
y2=feval(F,P2) ; 
cond=0; j=0; 
while(j<maxj&cond==0) 
len=norm(PO) ; 
if (y0O<y1l) 
P2=P1 ; 
72=y1; 
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bh=h/2; 
P1=PO+hzrS ; 
y1=feval(F,P1) ; 
el]Sse 
if(y2<y1) 
P1l=P2 ; 
yl=y2; 
了 =2*#h ; 
P2=PO+2*hx*S ; 
y2=feval(F,P2) ; 
el1Se 
Cond=-1 ; 
end 
end 
j=j+1l; 
if(h<delta) ,cond=1;end 
if(abs (h)>bigllen>big) ,cond=5;end 
end 


if(cond==5) 
Pmin=Pl， 
ymin=yLl; 
elSse 
d=4*+y1-2*+*yO-2*y2; 
if(d<0) 
hmin=h*(4*y1-3*y0-y2)V/d; 
elSe 
Cond=4; 
hmin=h/3， 
end 


%MConstruct the next point 
Pmin=PO+hminrS ; 
ymin=feval(F,Pmin) ; 


Determine magnitude of next h 
bh0O=abs (hmimn) ; 

htl=abs (hmin-h) ; 

h2=abs (hmin-2x*h) ; 

if (h0<h) ,h=h0;end 

if (hli<h) ,h=hl;end 

if (h2<h) ,h=h2;end 

if (h==0) ,hb=hmin;end 

if (h<delta) ,cond=1tiend 
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YTermination test for minimization 
e0=abs(y0-ymin) ; 
el=abs(y1-ymin) ; 
e2=abs (y2-ymin) ; 
if (e0~=0&e0<erIT) ,erT=e0;end 
if(el~=0&wel<err) ,erTr=el;end 
if(e2~=0&we2<err) ,err=e2;end 
if(e0==0&kel==0we2==0) ,err=0;end 
if (err<epsilon) ,cond=2;end 
if(cond==2&h<delta) ,cond=3;enad 

endQ 

Cnt=Cnt+l ; 

P(cnt+1l,:)=[Pmin ymin] ; 

PO=Pmin ; 

y0=ymin; 

end 

if(show==1) 
disp(P) ; 

enda 


了 xercises for Minimization of a Function 


1. Use Theorem 8.1 to determine where each of the following functions is increasing 
and where it is decreasing. 


(a) Fo)J==2x3 9xr?z 十 12x 5 
(D) Joo0=xVc+D 
(cj je) =( 人 二 DA 


(Go = 和 
2.Use Definition 8.3 to show that the following fonctions are unimodal on the given 
intervals. 


(Ga) Fo)=x2 2x 二 1;[0,4] 
(bj jx) = cosG); [0,3] 
(Fo = [10] 
(di joy) = xG 25250330,3] 
3. Use Theorems 8.3 and 8.4, if possible, to find all local minima and maxima of each 
ofthe following functions on the given interval， 
(a] Foz)=4x3 8x2 LIx 十 5;[0,2] 
(jeo) = 工 二 322 [0.5,3] 
(人 Foo0=( 人 十 2314 xz)5[ 19,1.9] 
(四 jz) = ex/x2 [0.5,3] 
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(e) Jo) 三 sin(Cx) Sin(37)/3; [0,] 
介 。 Fo)= 2sin(x) 十 sin(2x) 2sin(3x)/3; [1,3] 


4. Find the point on the parabola 》 一 X2 that is closest to the point (3, 1)， 


154. 


。Find the point on the curve 》 一 Sin(x) that is closest to the point (2, ]). 
。Find the point(s) on the circle x2 十 y2 一 25that is farthest from the chord 4 好 证 


4A= (3,4) and 了 =( 1,V24). 

Use Theorem 8.$ to find the local minimum of each of the following functions. 
(a) er,7)=xz3 十 中 3xr 3y 十 5 

(b) Fl 人 = 妈 十 2+x 27 xy 二 1 

(Fox, 放 =22yT2D 377 

(Fe 念 =C /2 十 六 十 2) 

(Flx,=1000 22 加 

(Rosenbrock's parabolic valley, circa 1960) 


。、Let 及 = (2，3,G = (Land 且 =(3,2). Find the points M, 民 ,and 丈 and 


sketch the triangles that are involved. 


，Let 下 =( 12)G 一 ( 2，S),and 卫 一 (3,.1). Findthe points M,R 民 and 鳌 and 


Sketch the triangles that are involved. 


Give a vector proof that M = (号 + C)/2is the midpoint of the line Segment joining 


the points 如 and C. 


。Give a vector proof of equation (10). 
。 Give a vector proof of equation (11). 


。Give a vector proof that the medians of any triangle intersect at a point that is two- 


thirds of the distance from each vertex to the midpoint of the opposite side. 


。Let 已 = (0.0,0),G = (1 10),P 忆 = (0,.0, 1),and 歼 = (1.0,0). 


(a) Sketch the tetrahedron 有 GP 信 

(b) Find af = (号 二 G 二 )/3. 

(C) Find 录 =2M 克 andsketchthetetrahedron PCPR. 
(dJ) Fnd 五 二 2R Mandsketch thetetrahedron BC PE 


Let 吃 = (0,0,0), G = (0,2,0), 一 = (0,1,1), and 现 = (2,1,0). Follow the 
instructions in Exercise 14. 


Algorithms and Programs 





1 


2. 


Use Program 8.1 to find the local minimum of each of the functions in Exercise 3 
with an accuracy of eight decimal places. 


Use Program 8.3 to find the local minimum of each of the functions in Exercise 3 with 
an accuracy of eight decimal places. Start with the midpoint of the given interval. 
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。Use Program 8.2 to find the minimum of each of the functions in Exercise 7 with an 


accuracy of eight decimal places. Use the following starting vertices: 
(a) (1,2), (2,0), and (2, 2) 
(b) (0, 0), (2,0), and (2, 1) 
(cj (0.0), (2,0), and (2. 1) 
(d) (0,0), (0, 1D, and (1, 1) 
(e) (0,0), (10), and (0, 2) 


。Use Program 8.4 to find the minimum of each of the functions in Exercise 7 with an 


accuracy of eight decimal Places. Use the starting vertex: 
(a) (1 2 (b) 〈0, 0.3) (c) 《0.10.1) 
(dj) 〈0.9,0.11) (e) (0,0) 


In Program 8.4 the x and y coordinates of the iterations are stored in the first two 
columns of the matrix P, respectively. Modify Program 8.4 so that it will plot the z 
and y coordinates of Ethe iterations on the same coordinate System. Hint. Incorporate 
the command Plot(P(:,1),P(:,2),:.:) intoyourprogram. Use this program on 
the functions in Exercise 7. 


。Use Program 8.2 to find the local minimum of each of the following functions; with 


an accuracy of eight decimal places. 
(a) Fe, yz) 一 2x2 二 272+z 2xy+yzZ 77 4z 
Start with (1, 1, 1), (0, 1 0), (1,0, 1), and (0, 0, 1)， 
(b) Feyz 人 一 202 十 2 二 22 二 iD) x+z + 3z 8y 5z 9u 
Start the search near (1,， 1, 1, ]). 
1 1 1 1 
(@] xyz 一 xyz& 十 一 十 二 十 -十 一 
X yy 7 
Start the Search near (0.7, 0.7, 0.7, 0.7). 


Use Program 8.4 to find the local minimum of each of the functions in Problem 6. 
Use a starting value near one of the given vertices. 


。Use Program 8.1 and/or 8.3 to find all local maxima and minima of the following 


function in the interval [0, 2]， 


FoD= x3 二 x2 12x 12 
2x6 3x5 4x4 十 9x2 十 12x 18 


Find the point on the surface z 一 X2 十 好 that is closest to the point (2, 3, 1 上. 


A company has five factories A,B，C，D,，and E， located at the points (10, 10)， 
(30, 50)，(16.667, 29)，(0.555, 29.888), and (22.2221, 49.988), respectively, in the 
XZy-pPlane，Assume that the distance between two points Tepresents the driving dis- 
tance, in miles,between the factories， The company Plans to build a warehouse at 
some Point in the Plane. It is antcipated that during an average Week there will be 10， 
18, 20, 14, and 25 deliveries made to factories A, B, C, D, and E, respectively. Ideally， 
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to minimize the weekly mileage of delivery vehicles, where should the warehouse be 
located? 


11. In Problem 10, where should the warehouse be located if due to zoning restrictions， 
it must be located at a point on the curve y 一 x2? 





solution of Differential 玉 quations 


Differential equations are commonly used for mathematical modeling in science and 
engineering. Often there is no known analytic solution and numerical approximations 
are required，As an illustration，we consider population dynamics and a nonlinear 
System that is a modification of the Lotka-Vojlterra equations: 
xjorn=r ti 了 工 误 and yo 人 一 区 y 二 六 
? 9 10 9 9 20 
with the initial condition x(0) = 2 and y(0) = 1 for 0 < 1 < 30.， Although the 
numerical solution is a list of numbers, it is helpful to plot the polygonal path joining 
the approximation points {(xk，yk)} and Plot the trajectory shown in Figure 9.1. In this 


了 
1.S 
1.0 
0.5 
Figure 9.1 The trajectory for a 
nonlinear System of differential 
0.0 X _ equations x”′ 一 lt,x,y) and 


0.5 1.0 1.5 2.0 y 一 87，y). 
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C=2 C=1 C=0 





Figure 9.2 The solution curves y() 一 上 十 e 上 十 C. 


chapter we present the standard methods for solving ordinary differential equations， 
Systems of differential equations, and boundary value problems. 


Introduction to Differential Equations 


Consider the equation 
(1) -一 一 e 工 . 


Itis a differential equation because it involves the derivative dy/dt of the “unknown 
function”y = y( 们 .Only the inpdependent variable ! appears on the right side of 
equation (1): hence a solution is an antiderivative of 1  e “. The rules of integration 
can be used to find y( 妆 : 


(2) y( 人 = 二 e 上 +C， 


where C is the constant of integration. All the functions in (2) are Solutions of (1]) 
because they satisfy the requirement that y (人 一 1 ee 5 They form the family of 
Curves in Figure 9.2. 

Integration was the technique used to find the explicit formula for the functions 
in (2), and Figure 9.2 emphasizes that there is one degree of freedom involved in the 
Solution, that is, the constant of integration C. By varying the value of C, we “movethe 
solution curve” up or down, and a particular curve can be found that will pass through 
any desired point. The secrets of the world are seldom observed as explicit formulas. 
Instead, we usually measures how a change in one variable affects another variable. 
When this is translated into a mathematical model, the result is an equation involving 


the rate of change of the unknown function and the independent and/or dependent 
Variable. 
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Figure 9.3 The solution curves 
1 y=A4+(X 4)e 如 for Newton's 
law of cooling (and warming)， 





Consider the temperature y(1) of a cooling object. It might be conjectured that the 
rate of change of the temperature of the body is related to the temperature difference 
between its temperature and that of the surrounding medium， Experimental evidence 
verifies this conjecture，Newton's law of cooling asserts that the rate of change is 
directly proportional to the difference in these temperatures. If 4 is the temperature of 
the surounding medium and y(1) is the temperature of the body at time 1, then 


dy 
G) 万 == CO7  4)， 


whereKis a positive constant. The negative sign is required because dy/dt will be neg- 
ative When the temperature of the body is greater than the temperature of the medium. 

Ithe temperature of the object is known at time ! = 0,， we call this an initial 
condition and include this information in the statement of the Probem Usually，we 
are aSKed to Solve 


Q ， 
图 宛 = ko 4 wi 吊 y(O)=x 
The technique of separation of variables can be used to find the solution 
(3) yy 一 4 二 (Oo 4)e 入 


For each choice of yo, the solution curve will be different, and there is no simple 
way to move one curve around to get another one. The initial value is a point where the 
desired solution is“nailed down.” Several solution curves are shown in Figure 9.3, and 
it can be observed that as ! gets large the temperature of the object approaches room 
temperature. 革 yo < 4, the body is warming instead of cooling. 


Initial Value Problem 
Definition 9.1. Asolxiionr to the jpiial aire propieme (了 VYP) 


(6) y = with 7(o)= 加 
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Figure 9.4 The slope field for the 
tf _ differential equation y = 了 (xy) 一 
C 妇 /2 





on an interval [加 ,pis adifferentiable function y 一 y(b such that 
(7) y(o)=y0 and yG=fGyD) for alre[to,b]. 和 


Notice that the solution curve y 一 y (人 must pass through the initial Point (加 ,yo0)， 


Geometric Interpretation 


At each point (!, y) in the rectangular region RR = {(t 7) :a<lI<pc<y< dd， 
the Slope of a solution curve 》 一 y(f) can be found using tbe implicit formula mm 一 
Gy7(D). Hence the values mi ij = Ji yj) can be computed throughout the rectan- 
8gle, and each value mi,j Tepresents the Slope of the line tangent to a solution curve that 
passes through the point ( 右 ，y 放 . 

A siope field or direction field is a graph that indicates the slopes {72i 71 ) over the 
region. It can be used to visualize how a solution curve “fits”the slope constraint, To 
move along a solution curve, one mnust start at the initial point and check the Slope 
field to determine in which direction to move. Then take a small step from 1 to 如 十 瑚 
horizontally and move the appropriate vertical distance 户 f (10, yo) so that the resulting 
displacement has the required slope， The next point on the Solution curve is (， ?1)， 
Repeat the process to continue your journey along the curve. Since a finite number of 
steps will be used, the method will produce an approximation to the solution. 


了 Example 9.1. The slope fieldfor y = (! y)/2overthe rectangle 愉 三 (Gy):0<f < 


S$,0<y<4lis shownin Figure 9.4. The solution curves with the following initial values 
are Shown: 


1. For y(0) = 1l, the solhution is y(D = 3e 2 2 十 纺 
2. For y(0) = 4,the solhution is y( 人 ) = 6e ! 2 十 上 加 
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Definition 9.2. Given the rectangle 尺 = {( 人 yy):a<tr<pc<y<xd,assume 
that F, y) is continuous on 妇 . The function is Said to satisfy a ZapScPi 克 co12diOP 
in the variable y on 尺 provided that a constant 了 > 0 exists with the property that 


(8) 1 7D ty 三 7 22| 


whenever (1 y1), (1，y2) < 民 . The constant ZL is called a ZipscPiz cortsta1tt for 太 ， 人 


Theorem 9.1. Suppose that ji, y) is defined on the region RH there exists a 
constant 环 > 0 So that 


(9) IJISZ foral (>)<R， 


then 六 satisfies a Lipschitz condition in the variable y with Lipschitz constant 上 over 
the rectangle 民 . 


Proof Fixrtand usethe mean value theorem to get cl with y1 < cl < y2 sothat 


fy GO 三 tcDO 72)| 
三 | 儿 Gclll7 22 大 ZI 2|. 


Theorem 9.2 (了 xistence and Uniqueness). Assume that 三 4, y) is continuous in a 
region 尺 三 {( 作 7) :<f<pbpc<y<xd.IsatisfiesaLipschitz condition on 尺 
in the variable y and (b, 0) e R, then the initial value Problem (6), y = jy) with 
y(10) = yo, has a unique solution y = y(1) on Some subinterval 如 < 了 二 加 十 4. 


Proof See atext on differential equations such as Reference [38]. @ 


Let us apply Theorems 9.1 and 9.2 to the function Ge, y) = (! ， 妆 /2.The partial 
derivative is 户 ( 7) = 1/2. Hence | 方才 7 旋 | < 和 and, according to Theorem 9.1， 
the Lipschitz constant is 了 一 志 . Therefore, by Theorem 9.2 the 工 VP has a unique 
Solution. 

Sketches of the slope field and solution curves can be constructed by using the 
meshgridand quiver commands in MAILAB. The following M-hile will generate a 


graph analogous to Figure 9.4. In general, care must be taken to avoid points (1，y) at 
which y is undefined. 
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[ 比 ,y]=meshgrid(1:5,4:-1:1) ; 
dat=ones(5,4) ; 

dy=(t-y)/2; 
quiver(t,y,dt,dy) ; 

hold on 

X=0:.01:5; 
Z1=3*#kexp(-X/27-2+X; 
Z2=6*#eXP(-X/27-2+Xj 
plot(x,zl,x,z2) 

hold off 


Exercises for Introduction to Differential Equations 


In Exercises l through $: 
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(a) Show that y(1) is the solution to the differential equation by substituting y(D) and 


7 (0 into the differential equation y/ (0 = jy(D))， 


(b) Use Theorem 9.1 to find a Lipschitz constant 忆 for the rectangle 尺 ={(f,y) :0< 


1I<3,0<y<35]. 
1 yY=1 yyD=Ce :+b2 2+2 
2.y=37+3tyD 一 Ce 和 
3.y = (GD = Ce /2 
4.y=e2 2yy0 一 Ce 2 十 te2 
S. =2007( 人 =1/C DO) 


in Exercises 6 through 9,， construct a graph of the slope field mi j) = jy J) over the 
rectangleR= {(y) :0<f<40<y<4andtheindicated solution curves on the 


Same coordinate System. 


6.y = tyy=(C DPI forCc=12.4,9 


7.y=tWyyO=(C+ 的 人 forC= 4 114 
8. =1/)yD=(C+20V2 forC= 4，2.0,2 


9.yY=y7y0D=1(C 0 forCc=1123,4 


10. Here is an example of an initial value problem that has“two solutions” y 一 y1/ 3 


with 7(0) = 0. 

(a) Verify that y( 人 ) 一 0forr > 0is asolution. 
(b) Verify that y(f) 一 1/2 fort > 0is asolution. 
(c) Does this violate Theorem 9.2? Why? 
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Consider the initial value problem 
y=( 02 7y0O)=0 
(a) ”Verify that y(0) = Sin(b) is a solution on [0, 交 /4]. 
(bj) Determine the largest interval over which the solution exists. 


Show that the definite integral / JOD dr can be computed by solving the initial value 
problem 


y=j fora<r<pb with ya)=0. 


In Exercises 13 through 1$, fnd the solution to the IVP, 


13. 
14. 


1S. 
16. 


17. 


多 =31 二 sin(, y(0) = 2 

y= 过,y7(0) =0 

YY 一 e 上 2/ 2 y(0) = 0. Hint This answer must be expressed as 3 certain integral, 
Consider the first-order differential equation 


y(D 二 pP(D7G) = 9(GD)， 


Show tbat the general solution y(f) can be found by using two special integrals. First 
define 屎 (1t) as follows: 


FEGD) 一 e12O0d4. 


Second, define y(i as follows: 


1 
y(b) 三 FG (/ 天 (Dag( dt 十 c] . 


Hant Differentiate the product 已 (y(0). 


Consider the decay of a radioactive substance， If y(D) is the amount of substance 
Present at time 1 then y(1) decreases and experiments have verified that the rate of 
change of (1) is proportional to the amount of undecayed material. Hence the LVP 
for the decay of a radioactive Substance is 


7 = ji with  y(0)= 0. 


(aj ”Show that the solution is y(1) 一 yoe 帮 . 

(b) The half-life of aradioactive substance is the time required for half of an initial 
amount to decay, The half-life of :4C is 5730 years. Find the formula y(D that 
gives the amount of 4C present at time !、 Hint Find K so that y(5730) 一 0.5y0， 

(cj A piece of wood is analyzed and the amount of 14C present 1s 0.712 of the 
amount that was present when the tree was alive，How old is the sample of 
Wood? 

(d) At a certain instant， 10 mg of a radioactive substance is Present， After 23 sec- 
onds, only 1 mg is present. What is the half-life of the substance? 
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in Exercises 18 through 19. derive an equation for the LVP and find its solution. 


18. Annual ticket sales for a new professional soccer league are projected to grow at a 
rate proportionalto the difference between sales at time f and an upperbound of $300 
million. Assume that annual ticket sales are initially $0 and must be $40 million after 
3 years (or the league folds). Based on these assumptions, how long will it take for 
annual ticket sales to reach $220 million? 


19. The interior volume of a new library is 5 millon cubic feet， The ventilation system 
introduces fresh air into the library at the rate of 4$,000 cubic feet per minute. Before 
the ventilation System is turned on, the percents of carbon dioxide in the interior of 
the library and in the exterior fresh air are measured at 0.4% and 0.5%, respectively. 
Determine the percentage of carbon dioxide in the library 2 hours after the ventilation 
System is started. 


Euler”s Method 


The reader should be convinced that not all initial value problems can be solved ex- 
Plicitly, and often it is impossible to find a formula for the solution y(; for example， 
there is no0“closed-form expression” for the solhution to y = 妇 十 六 2 with y(0) = 0. 
Hence for engineering and scientific purposes it is necessary to have methods for ap- 
Proximating the solution. 于 a solution with many significant digits is required, then 
more computing effort and a sophisticated algorithm must be used. 

Thbe first approach is called Euler's method and serves to illustrate the concepts 
involved in the advanced methods. It has limited usage because of the larger error that 
is accumulated as the process proceeds. However it is important to study because the 
error analysis is easier to understand. 

Let [c, p] be the interval over which we want to find the solution to the well-posed 
LVP y = jy 人) with y(a) = yo In actuality，we will not find a differentiable 
function that Satisfies the I.VP，JInstead, a set of points {( 灵 , 办)} is generated, and 
the points are used for an approximation (ie.，y( 大 ) 久 多 )， How can we proceed to 
construct 8 “set of points”that wil“satisfy a differential equation approximately”? 
First we choose the abscissas for the points. For convenience we subdivide the interval 
[a, 中] into M equal subintervals and select the mesh points 


和 
(CD 太一 aa 和 forE=01 .Mowherep=2 4 





The value /is called the step size. We now proceed to solve approximately 


(2) 7 = over [ptr] with  y(o) = y0. 
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Assume that y(, y (0，and 允 () are continuous and use Taylors theorem to 
expand y(1) about ! 一 加. For each value t there exists a value cl that lies between 加 
and f! So that 


(cbDG 10)” 


(3) y(D = y(1o) 十 yY(o)( 加 ) 十 5 


When y (fo) = jio, y(to)) and 严 一 五 加 aresubstituted in equation (3), the 
result is an eXpression for y(): 


天 2 
(4) ?CD = 》(1) 十 忆 Fto, y( 加 )) 十 7 (CD 


还 the step size 玉 is chosen small enough, then we may neglect the second-order 
term (involving A2) and get 


(5) 嫉 三 70 十 Ato, 70)， 
Which is 五 xler3s CPProxzizazdio7z. 


The process is repeated and generates a sequence of points that approximates the 
solution curve 》 = y(1). The general step for Euler's method is 


(0 HH 三 不 十 ， HI 一 次 十 Ap for=0 1 ...，M 1. 


Example 9.2， Use Euler's method to solve approximately the initial value problem 
(7) 》= Ry over [0,1] with y(0) = yo and R_ constant. 


The step size must be chosen, and then the second formula in (6) can be determined 
for computing the ordinates. This formujla is sometimes called a difference equation, and 
in this case it js 


(8) +1I 王 次 (1 十 PR) for 大 =0 1 ...，M 1 
If we trace the solution values recursively, we see that 
71 = 一 yo 十 疡 及 ) 


六 三 J(1E 十 放 R) 一 y0(1 十 玉 民 )2 
(9) 


yM 王 JU 1 十 AR) = yo0(1 十 有 R)4 
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Table 9.1 ” Compound Interest in Example 9.3 









Step Number of 
Size, 卢 iterations，M Approximation to y(3), ynMf 





5 
1000 (4 十 于 ) = 1610.51 


60 
1000 (4 十 和 ) 一 1645.31 


1800 
1000 ( 十 吗 ) = 1648.61 
360 





For most problems there is no explicit formula for determining the solution points,and 
each new point must be computed Successively from the prevjious point. However, for the 
initial value problem (7) we are fortunate; Euler's method has the explicit solution 


(10) 灵 一 上 次 王 yo PR for 大 一 0 1 ...，M， 


Formula (10) can be viewed as the“compound interesf”formula, and the Euler ap- 
Proximation gives the future value of a deposit. 国 


Example 9.3. Suppose that $1000 is deposited and earns 10% interest compounded con- 
tinuously over 5 years. What is the value at the end of $ years? 

We choose to use Euler approximations with 户 = 1， 十 ， and 疝 to approximate y(9) 
for the [I.V.P: 


?=0.1y over [0,5] with y(0) = 1000. 
Formula (10) with 尺 = 0.1 produces Table 9.1， 国 


Think about the different values 75，y60,， and y1800 that are Used to determine the 
future value after 5 years，These values are obtained using different step sizes and 
reflect different amounts of computing effort to obtain an approximation to y($). The 
solution to the 开 V.P is y(S) 一 1000e05 = 1648.72. If we did not use the closed-form 
solution (10), then it would have required 1800 iterations of Euler's method to obtain 
y1800, and we still have only five digits of accuracy in the ansWerl 

芝 bankers had to approximate the solution to the LV.P (7), they would choose Eu- 
lers method because of the explicit formula in (10). The more sophisticated methods 
for approximating solutions do not have an explicit formula for finding 从 ,but they 
will require less computing effort. 


Geometric Description 


开 you start at the point (10, y0) and compute the value of the Slope 10 = (io, y0) 
and move horizontally the amount A and vertically Ar (to, yoj, then you are moving 
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1 Figure 9.$S Eulers approximations 
AT 二 了 俯 十 声 FK 从) 





along the tangent line to y(1) and will end up at the point ( 阅 ,yI1) (see Figure 9.5). 
Notice that (0, YU is not on the desired solution curve! But this is the approximation 
that we are generating，Hence we must use (fyY1) as though it were correct and 


proceed by computing the slope ml = /ov and using it to obtain the next vertical 
displacement An， yi to locate (ya), and so on 


Step Size versus Error 


The methods we introduce for approximating the solution of an initial value problem 
are called djerence metjiods or discrete rariaple mmethods.， The solution is apPprox- 
imated at a set of discrete points called a grid (or mesh) of points，An elementary 


Single-step method has the form YL 三 从 十 1 中 (人 wj for some function @ called 
an PICremaze1at Forzczorz， 


When using any discrete variable method to approximately solve an initial value 
problem, there are two Sources of error': discretization and round off 


Definition 9.3 (Discretization Error)。 Assume that {( 丰 ， y)] 人 o is the set of dis- 
crete approximations and that y = y(D is the unique solution to the initial value Prob- 


lem. 
The 8iopal discretizafiom error er is defined by 
(10) EK 一 YI 人 forK==-0 1...，hM4. 
Itis the difference between the unique solution and the solution obtained by the discrete 
variabie method. 
The 1ocal discretizatiom error et+Hlis defined by 


(12) EK+1 一 YY(NHD WA) ftor 大 一 0 1 .1M 1 


ltis the error committed in the single step from AN to 从 二 1， 委 
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When we obtained equation (6) for Eulers method, the neglected term for each 
step Was y(C2)(cb(P272). Ithis was the only error at each step, then at the end of the 
interval [c, p], after M steps have been made, the accumulated error would be 


(ayO(c) 


__ 1 
本 = 一 O(A ). 


杂 2 2 

天 严 PHMf 
》 7 和 (co 三 冬 My7 (co 二 本 (OA 一 
类 一 1 


There could be more error but this estimate predominates. A detailed discussion on 
this topic can be found in advanced texts on numerical methods for differential equa- 
tions (Reference [75]). 


Theorem 9.3 (Precision of Euler”s Method)， Assume that y(f) is the solution to 
theV.P given in (2). 玉 y( 人 (1 E C2[1o, 有 b] and {( 太 ， 其 )] 人 0 is the sequence of approxi- 
mations generated by Euler's method, then 


lek| 一 jy7() = 一 Op)， 
|et = ly(krD 交 Royo0l= O0， 


The error at the end of the interval is called the jinaal gilopal error ( 严 G. 匹 .): 


〈1) 


414) EO), JI=ly) = OOD， 


Rermark. The fnal global error E(y( 世 ,ji is used to study the behavior of the error for 
various step Sizes. It can be usedto give us an idea of how much computing effort mnust 
be done to obtain an accurate approximation. 

Examples 9.4 and 9.S illustrate the concepts in Theorem 9.3. If approximations are 
computed using the step sizes 疡 and 严 /2, we Should have 


〈15) 尼 O(O) ,js CR 


for the larger step size, and 


天 A 1 
(16) 已 (>@w 引 s CC = 了 CA BECO(D)， 让， 


工 
2 


Hence the idea in Theorem 9.3 is that itthe step Size in Euler's method is reduced by a 
factor of 了 we can expect that the overall F.G.E. will be reduced by a factor of 让. 


Example 9.4. Use Eulers method to solve the I.VP. 
/7 >》 。 
y 一 一 on [0, 3] with y(0) 一 荆 . 


Compare Solutions for 灵 一 1， 放 ， 于 ， and 到 
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1.0 了 = 了 
0.5 


0.0 0.5 1.0 1.5 2.0 2.5 3.0 


Figure 9.6 Comparison of Euler solutions with different 
step sizes for y = (! 7y)/2 over [0, 3] with the initial 
condition y(0) = 1. 


Figure 9.0 shows graphs of the four Euler solutions and the exact solution curve y(0) 一 
3e !2 2 十 上 Table 9.2 gives the values for the four solutions at selected abscissas. For 
the step size 严 = 0.2$, the calculations are 


0.0 1.0 
J1 一 1.0 十 0.25 ( 富 ) 一 0.87S， 


0.25 ”0.873 
一 0.875 十 0.25 (一 一 | 一 0.796875， etc. 
This iteration continues until we arrive at the last step: 


一 1.604252， 县 


2.75 1.44057 
y(3) sa = 1.440573 十 0.25 (一 玫 ) 


了 Example 9.S， Compare the FG.E. when Eulers method is used to solve the LV.P. 
》 。 
》 一 一 over [0, 3] with y(O) = 1， 


using step sizes 1 3 元，. ….， 二 


04 
Table 9.3 gives the EG.E. for Several step sizes and shows that the error in the approx- 
imation to y(3) decreases by about 也 亏 When the step Size is reduced by a factor of 二 FoOr 
the Smaller Step Sizes the conclusion of Theorem 9.3 is easy to See: 


E(y(G3), 有 一 y>G3) yw = ODSCh， where  C = 0.256. 本 
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Table 9.2 ”Comparison of Euler Solutions with Different Step Sizes fory 一 (( yy)/2 
over [0, 3] with y(0) = 1 




















y(k) Exact 


1.0 1.0 1.0 





































0.125 0.9375 0.943239 
0.25 0.875 0.886719 0.897491 
0.375 0.846924 0.862087 
0.50 0.75 0.796875 0.817429 0.836402 
0.75 0.759766 0.786802 0.811868 
1.00 0.6875 0.758545 0.7901S8 0.819592 
1.S0 0.765625 0.846386 0.882855 0.917100 
2.00 0.949219 1.030827 1.068222 1.103638 
2.50 1.211914 1.289227 1.325176 1.359514 


1.533930 1.604252 1.637429 1.669390 





Tabie 9.3 “Relation between Step Size and F.G.E. for Euler Soltutions to 
y=( J)/2over [0,3] with y(0) = ] 


FG.E， Oo s CR 
Step Number of Approximation Error at 一 3， where 
size, 忆 steps，M to y(3),yM yG) yyM C = 0.256 
1 1.375 0.294390 0.256 
和 1.533936 0.135454 0.128 
了 1.604252 0.065138 0.064 
1.637429 0.031961 0.032 
二 1.653557 0.015833 0.016 


示 1.661510 0.007880 0.008 


1.665459 0.003931 0.004 


科 一 
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Program 9.1 (Eujler's Method)，To approximate the solution of the initial value 
problem y = Gy) with y(a) = yo over [a, b] by computing 


了 HI 三 次 十 Atk) for 大 =0 1. M 1 


function E=euler(f,a,b,ya,M) 





%InpPut -~ f is the function entered as a String 于 ， 

为 - a and b are the left and right end points 

外 - ya is the initial condition y(a) 

人 -NM is the number of steps 

YXDutput - E=[T' Y:] where T is the vector of abscissas and 
久 Y is the Vector of ordinates 

h=(b-a)VM; 


T=zeros (1 ,M+1) ; 

Y=Zeros (1,M+1) ; 

T=a:hib; 

Y(1)=ya; 

for j=1:M 
Y(j+1l)=Y(j)+h*feval(f,T(j),Y(j)); 

end 

E=[T:， YY] ; 


了 Exercises for Euler's Method 


In Exercises 1 through 5 solve the differential equations by the Euler method. 


(a) Let 疡 = 0.2 and do two steps by hand calculation，Then let 严 = 0.1 and do four 
steps by hand calculation. 

(b) Compare the exact solution y(0.4) with the two approximations in Part (a). 

(ec) Does the FG.E. in part (a) behave as expected when jh is halved? 


1 多 一 弓 ywithy(0) 一 1yOD= e+ 2 上 +2 

2.y=37+3f withy(0) =1yD= 和 ce 1 

3.y 二 她 withy(0) =1yD 一 e P02 

4.yY=e2 2ywithy(0)= 击 ,yD 一 而 e 2 二 te 2 

S. yy 一 217 withy(O) 一 1yD=1G D2) 

6. Losgistic popujation growth. The population curve P( for the United States is 


assumed to obey the differential equation for a logistic curve P' = waP  P2. Lett 
denote the year past 1900, and let the step size be 挛 = 10. The values a = 0.02 and 
六 = 0.00004 produce a model for the population. Using hand calculations, find the 
Euler approximations to P() and fll in the following table. Round off each value 户 
to the nearest tenth. 
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忆 人 tk) 产 
Actual Euler approximation 











7. Show that when Euler's method is used to solve the I.VP 
y = over [ab with yo) = =0 


the result is 
af 1 
y(D) s 》 CDP， 
大 =0 


which is a Riemann Sum that approximates the definite integral of 太 (f) taken over the 
interval [ac, 放 ]. 


8. Show that Euler's method fails to approximate the solution y(1) = 13/2 of the LVP 
yY= dt7)=15y03 with  y(0) = 0 


Justify your answer What diffculties were encountered? 
9，Can Eulers method be used to solve the 1VP 


外 =1 二 刀 2 over [0,3] with y(0) = 0? 


int The exact solution curve is y(0) = tan(1)， 


Algorithms and Programs 


In Problems 1 through $, solve the differential equations by the Euler method. 


(a) Let 产 三 0.1 and do 20 steps with Program 9.1. Then let 户 一 0.05 and do 40 steps 
with Program 9.1， 


(b) Compare the exact solution y(2) with the two approximations in part (3). 
(c) Does the FEG.E. in part (a) behave as expected when hm is halved? 
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(d) Plot the two approximations and the exact solution on the Same coordinate System. 


人 Pr 


吧 


Hint The output matrix E from Program 9.1 contains the x and y coordinates of 
the approximations，The command PLlot (E(: ,1),E(:,2)) will produce a graph 
analogous to Figure 9.6. 


.yY=1 ywithy0)=1LyD= e+ 2r+2 


一 37 十 3f with y(0) = 1,y() =3e3 革 和 


y = 1withyO =1y0D =e 2 


y=e2 2ywithy(0)= 古 ,7y( 们 一 站 ee 并 十 te 


.多 三 21 with y(0) 一 17G 罗 = 一 1 手 ) 
。Consider y 三 0.12y over [0, $] with y(0) = 1000. 


(a) Apply formula (10) to find Eulers approximation to y(3) using the Step Sizes 
疡 = | 古 , and 而 . 

(bj) What is the limit in part (a) when 凡 goes to zeroy 

Exponenaal popujaton grow 妇 ， TIhe population of a certain Species grows at a rate 

that is proportional to the current population and obeys the 1VP 

y 一 0.02y over [0, 5] with y(0) 王 S000. 

(a) Apply formula (10) to find Euler's approximation to y($) using the Step sizes 
六 = 1 证 ,and 二 

(b) What is the limit in part (a) when 六 goes to Zero? 

A skydiver jumps from a plane, and up to the moment he opens the parachute the 


air resistance is proportional to y3/2 (y represents velocity)，Assume that the time 
interval is [0, 6] and that the differential equation for the downward direction is 


内 一 32 0.032v3/2 over [0,6] with uv(0) = 0. 


Use Eulers method with 疡 = 0.05 and estimate 7(6)， 


。 PEpidemic model， The mathematical model for epidemics is described as follows. 


Assume that there is a community of 也 members that contains 己 infected individuals 
and C uninfected individuals. Let y(t) denote the number of infected individuals at 
time !. For a mild illness, such as the common cold, everyone continues to be active， 
and the epidemic spreads from those who are infected to those uninfected，Since 
there are PC possible contacts between these two groups, the rate of change of y( 四 
is proportional to PO@. Hence the problem can be stated as the [I.V.P, 


y= 忆 EL 访 with 7yO0)=y. 


(a) Use 世 = 2S$,000, 丰 = 0.00003, and 产 = 0.2 with the initial condition y(0) 一 
2S0, and use Program 9.1 to compnute Euler's approximate solution over [0, 60]. 
(b) Plot the graph of the approximate solution from part (a). 


(cj Estimate the average number of individuals infected by finding the average of 
the ordinates from Eulers method in part (a). 
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(d)  Estimate the average number of individuals infected by fitting a curve to the data 
from part (a) and using Theorem 1.10 (Mean Value Theorem for Iniegrals). 


10. Consider the first-order integro-ordinary differential equation 
了 
风 一 13y》 0.25y” oo000ly 人 y(z) dr. 
0 


(a) UseEulers method with 天 = 0.2, and y(0) = 2S0 over the interval [0, 20j, and 
the trapezoidal rule to fnd an approximate solution to the equation。 Binpt The 
general step for Euler's method (6) is 


不 
ykHl 一 次 十 R1.3 欢 0.257 oo 人 y(r)dz). 
0 


If the trapezoidal rule is used to appProximate the integral, then this expression 
becomes 


+1 一 关 十 由 (1.3 中 025 关 0.0001ykTkCo)， 
where 70( 由 三 0 and 
万 
到 (i 三 到 工 (7 十 了 (六 1 十 其 ) for 上 = 0 1 ..，99. 
(b) Repeat part (a) using the initial values y(0) = 200 and y(0) = 300. 


(Cj)  Plot the approximate solutions from parts (a) and (b) on the same coordinate 
System 


Heun's Method 


The next approach，Heun's method, introduces a new idea for constructing an algo- 
Trithm to solve the I.V.P 


(D) y (= over [四 with yo) = 3 


To obtain the solution point (0 y1)，we can use the fundamental theorem of calculus 
and integrate y (1) over [10, 1 to get 


二 娘 
O) 1 Fo yd 一 1/ ydr = yGD yo)， 
加 


如 


where the antiderivative of y() is the desired function y(1)，When equation (2) is 
solved for y(0), the resujt is 


纪 
G) yn = y(o) 十 1 dy(GD)adt 
加 
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Now a numerical integration method can be used to approximate the definite inte- 
gral in (3). Ifthe trapezoidal rule is used with the Step size 瑚 一 坟 加 ,then theresnult 
is 


下 
(4) 7 人) 之 7() 十 7(y to， y(ti)) 十 了 (CD))). 


Notice that the formula on the right-hand side of (4) involves the yet to be deter- 
mined value y(0)，To proceed, we use an estimate for y(0)，Eulers solution will 
suffice forthis purpose. After 让 is substituted into (4), the resulting formula for fnding 
(0, yU is called 豆 ecrz 和 112e 坟 0d: 


忆 
(S) y1 三 (to) 十 7 了 (fno， ?70) 十 jyo 十 PP(o, 7y0))). 


The process is Tepeated and generates a sequence of points that approximates the 
solution curvey = y(1). At each step, Euler's method is used as a prediction, and then 
the trapezoidal Tule ls used to make a correction to obtain the final value. The general 
step for Heun's method is 


Pk+1 王 次 十 Pf (大 ,次 )， HL 三 大 十 瑚 ， 
(0) 天 
了 AL 一 欢 十 了 CC， 基 ) 十 太 (+T1，PKH1))， 


Notice the role played by differentiation and integration in Heun's method. Draw 
the line tangent to the solution curvey = 三 y(f) at the point (加 , y0) and use it to find the 
Predicted point (0 P1). Now look at the graph z = 让, y(b) and consider the points 
(io, 加 0) and (人 ,万 ), where 矿 = to, yo) and 万 = 0, PpD). The area of the trape- 
2Zoid with vertices (加 , 如) and (人 户 ) is an approximation to the integral in (3), which 
is used to obtain the final value in equation ($). The graphs are shown in Figure 9.7. 


Step Size versus Error 

The error term for the trapezoidal rule used to approximate the integral in (3) is 
及 3 

7 @O(co 一 ， 

(7) y“ (ck) 


于 the only error at each step is that given in (7), after M steps the accumulated error 
for Heun's method would be 


G) > oO 和 抹 = 和 272 有 200 
各 ”2 


The next theorem is important,，because it States the relationship between F.G.E. 
and step Size. Itis used to give us an jidea of how much computing effort must be done 
to obtain an accurate approximation using Heun's Inethod. 


-一 一 一 -一 -一 一 一 一 
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一 
一 


局 (DPI1) 
-0 e (1 yi) 


-- (0 y(0)) 
we 
> = 了 ( 昌 


(do 四 ) z= 九 57y(D) 





加 避 


(a) Derivative predictor: (b) Integral corrector: 


卢 
Pi= +jrdo, yo) 71 一 加 = 了 00o+ 万 ) 
Figure 9.7 The graphs 》 一 y() and z = FU, yd)) in the derivation of Heun's method. 


Theorem 9.4 (Precision of Heun's Method)， Assume that y(D) is the solution to 


the [LVP (1). If y(D ee C3[10,b and {( 丰 ， yo i ls the sequence of approximations 
generated by Heun's method, then 


let| = 1y>() = O(0)， 


(9) 3 
|ekt+1 三 | 人 + 人 8( 人 让) 一 OO )， 


Where 中 (如 Jp) 三 次 十 (AI(CF( 语 十 FT 其 十 六 让 yb))， 
了 in particular, the fnal global error (KG.E.) at the end of the interval will Satisfy 


(10) EC 人, 月 一 ly yw = OO) 


Examples 9.6 and 9.7 jllustrate Theorem 9.4， 开 approximations are computed 
using the step sizes 疡 and 户 /2, we should have 


(1D) 尼 (y( 轨 ,月 SCP2 


for the larger Step size, and 


AN 12 1 1 
(12) 已 (>w， 引 筷 C 玫 一 ITC 入 了 BEOb)， 站. 


了 ence te jidea in Theorem 9.4 is that 这 the step size in Heun's method is reduced by a 
factor of 和 we can expect that the overall EG.E. will be reduced by a factor of 了 1 


-一 一 一 一 一 -一 一 一 一 一 一 一 一 一 一 
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0.0 0.5 1.0 1.5 2.0 


Figure 9.8 Comparison of Heun solutions with different 
step Sizes for y = (fy)/2 over [0,2] with the initial 
condition y(0) 一 二. 


卫 xample 9.60， Use Heun's method to solve the IVP, 


y 一 一 on [0,3] with y(0) = 1 


Compare solutions for 于 一 1， 芭 ， 于 and . 


Figure 9.8 shows the graphs of the firsttwo Heun solutions and the exact solution curve 
y( 一 3e :2 2+t Table9.4gives the values forthe four solutions at selected abscissas. 
For the step Size 瑚 三 0.29, a Sample calculation is 


0 1 
Jo, y0) = 一 = 0.5 
Pi = 三 1.0 二 0.2S$( 0.5) = 0.875， 
0.2$ ”0.875S 
JU PD 一 一 7 = 0.3125， 


嫉 三 1.0+0.123( 0.3 0.3125) = 0.8984375， 
This iteration continues until we arrive at the last step: 


y(3) 穴 y12 三 1.311508 十 0.125(0.619246 十 0.666840) = 1.672269. 四 


也 xample 9.7。 Compare the 下 G.E. when Heun's method is used to solve 
y== 一 over [0,3] with y(0) = 1， 


using step sizes 1， 二 . 而. 
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Table 9.4 ” Comparison of Heun Solutions with Different Step Sizes for y = (( ， y)/2 over 
[0,3] with y(O) = 1 































































天 一 7y( 帮 ) Exact 
10 | 10 1.0 

0.125 0.943359 0.943239 
0.25 0.898438 0.897717 0.897491 
0.375 0.862406 0.862087 
0.50 0.84375 0.838074 0.836801 0.836402 
0.75 0.814081 0.812395 0.811868 
1.00 0.875 0.831055 0.822196 0.820213 0.819592 
1.50 0.930511 0.920143 0.917825 0.917100 
2.00 1.171875 1.117587 1.106800 1.104392 1.103638 
2.50 1.373115 1.362593 1.360248 1.359514 

1.732422 1.682121 1.672269 1.670076 1.669390 








Table 9.5 “Relation between Step Size and F.G.E. for Heun Solutions to 
y=( 7y)/2overf0,3] with y(0) =1 





EG.E. O(p2) > CH2 
Step Number of Approximation Error at! 一 3， where 
Size, 天 Steps,， AM to y(3)， ya y(3) yyM CC 一 0.0432 
1 1.732422 0.063032 0.043200 
和 1.682121 0.012731 0.010800 
了 1.672269 0.002879 0.002700 
和 1.670076 0.000686 0.000675 
着 1.669558 0.000168 0.000169 
吉 1.669432 0.000042 0.000042 
二 1.669401 0.000011 0.000011 





Table 9.5 gives the 下 G.E. and shows that the error in the approximation to y(3) de- 
creases by about : 了 When the step size is reduced by a factor of 了 亏 


EO(3), 站 =y7G3) = OU2) s Ci2， whereC = 0.0432. 加 





448 CHAP.9 SOLUTION OF DIFFERENTIAL EQUATIONS 


Program 9.2 (Heun's Method)， To approximate the solution of the initial value 
problem y = 让 ,yy) with y(a) = yo0 over [a, p]by computing 


瑚 
了 +L 三 詹 十 7 tk， 共 ) 十 了 次 十 (让 ,区 ))) 


forK =0,1,.. ,AT |. 





function H=heun(f,a,b,ya;M) 


%Input -ff is the function entered as a String :f， 

包 ~ a and b are the left and Tight end Points 

% - ya is the initial condition y(a) 

% -~ M is the number of steps 

YXoutput - H=[TIY'] where T is the vector of abscissas and 
双 Y is the Vector of ordinates 

b=(b-a)VM; 


T=zeros (1 ,M+t) ; 

Y=zerogs (1 ,M+1) ; 

了 IT=a:h:b; 

Y(1)=ya; 

for j=1:M 
kl=feval(f,T(j),Y(j)); 
Kk2=feval(f,T(j+1),Y(j)+h*yk1t) ; 
Y(j+1l)=Y(j)+(h/2)*(Kt+k2) ; 

end 

H=[T?Y?] ; 


了 上 Exercises for Heun's Method 


In Exercises 1 through S solve the differential equations by Heun's method. 

(3a) Let 疡 = 0.2 and do two steps by hand calculation. Then jet 挛 = 0.1 and do four 

steps by hand calculation. 

(b) Compare the exact solution y(0.4) with the two approximations in part (a). 

(c) Does the EG.E. in part (a) behave as expected when Pis halved? 

1 y= 刀 ywithy(0)=1Ly0OD = e+P2 2r+2 

2. 了 =37 二 3Lwithy(OD) 一 1yOD 一 Se t 和 
3.yY= twithy0O)=1y(D 一 e 202 
4.yY=e2 2ywithy(0) = 下 ， 7y(D = 看 2 忆 十 1e 攻 


SEC. 
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.多 一 2172with y(0) =1y 人 =1/( 0) . 


Notice that Heun's method will generate an approximation to y(1) even though the 
solution curve is not defined at ! = 1 


。Show that when Heun's method is used to solve the LVP y = 矿 (O over fa, 中 with 


y(a) 一 =0theresultis 


忆 af 1 
7() = 了 部 WO 十 (x+ttD))， 


which is the trapezoidal rule approximation forthe definite integral of (0) taken over 
the interval [2, p]. 


。The Richardson improvement method discussed in Lemma 7.1 (Section 7.3) can be 


used in conjunction with Heun's method. I 开 Heun's method is used with step Size 忆 ， 
thea we have 


y() 之 芒 十 CR 
I 开 Heun's method is used with step Size 27, we have 
?CD) sy 十 4CP. 


The terms involving CAR2 can be eliminated to obtain an improved approximation for 
y(p), and the result is 


4 3 


The improvement scheme can be used with the values in Example 9.7 to obtain better 
approximations to y(3). Find the missing entries in the table below、. 














(3213 







1.669558 


1.605354 


1.669385 





1.669432 
1.669401 
Show that Heun's method fails to approximate the solution y(1) = 13/2 of the 1.VP 

yY= Fl, 疙 =15773 with yy(0) = 0. 


Justify your answer What difficulties were encountered? 
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Algorithms and Programs 
Cr | 


In Probljems 1 through 5 solve the differential equations by Heun's method. 


(a) Let 严 = 0.1 and do 20 steps with Program 9.2. Then let 户 = 0.05 and do 40 steps 


with Program 9.2. 


(b) Compare the exact solution y(2) with the two approximations in part (a). 
(a) Does the EG.E. in part (a) behave as expected when ji is halved? 


(a) Plot the two approximations and the exact solution on the same coordinate system. 


人 9 王 


Hint The output matrix H from Program 9.2 contains the x and y coordinates of 
the approximations，The command plot (H(; ,1) ,H(C:,2)) will produce a graph 
analogous to Figure 9.8. 


.y 多 一 1 ywithy(O) =1yOD= e+P2 2 上 +2 
.多 =37 二 31withy0) =1yD=ge 1 


3 
y= bwithyO0)=1y 人 一 e 772 
y=e 27withy(0) = 而,?(= 击 e 2 上 te 


y=2177 with y(0) =1 yy =1/G 0D) 


。 Consider a projectile that is fired straight up and falls straight down. If air Tesistance 


is proportional to the velocity, the I.VP forthe velocity v(D) is 
天 
/= 32 一 ith 0) = 270， 
也 万 Wi u(0) = v0 


Where 20 is the initial velocity,，M is the mass, and 及 the coefficient of air resistance. 


Suppose that vo = 160 ft/sec and 玉 /M = 0.1. Use Heun's method with = 0.5 to 
SoOlve 


六 


= 32 0.l over [0,30] with v(0) = 160. 


Graph your computer solution and the exact solution y( = 480e V10 320onthe 
same coordinate System. Observe that the limiting velocity is ”320 ftysec， 


。 In Psychology, the Wever-Fechner law for stimulus-response states that the rate of 


change dR/dS of the reaction R is inversely proportional to the stimulus. The thresh- 
old value is the lowest level of the stimulus that can be consistently detected，The 
工 VP for this model is 


有 RR' 一 with  R(So) = 0. 


四 | 交 


Suppose that So = 0.1 and R(0.1) = 0. Use Heun's method with 屎 = 0.1to solve 


民 ' 一 over [0.1, 5.1] with R(0.1D) = 0. 
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8、(a) “Write a program to implement the Richardson improvement method discussed 
in Exercise 7. 

(b) Use your program to approximate y(2) for each of the differential equations in 
Problems 1--$ over the interval [0, 2]、Use the initial step Size 挛 = 0.09. The 
program Should terminate when the absolute value of the difference between 
two consecutive Richardson improvements is < 10 6. 


Taylor Series Method 


The Taylor series method is of general applicability, and it is the standard to which we 
compare the accuracy of the various other numerical methods for solving an I.V.P 
can be devised to have any specified degree of accuracy，、We start by reformujlating 
Taylor's theorem in a form that is suitable for solving differential equations. 


Theorem 9.5 (Taylor's Theorem)， Assume that y( 人 ) e CAX +1[10, 了 ] and that y(b) 
has a Taylor series expansion of order N about the fixed valuez 一 太 E [io,D]: 


(1 y( 让 十 月 二 ye) 十 7w(y(GD) 十 ON+D， 
Where 

AN (站 ， 
O) moeygD) = 六 站 和 

7=1 “ 


and yj = FU DG y() denotes the (六 TDst total derivative of the function 太 
With respect to !. The formulas for the derivatives can be computed recursively: 
7 = 了 
7 = 及 十 7 = 有 户 上 万 / 
?60 一 记 十 2j7 十 万 光 二 Po 
= 大 十 2jp8 + 用 产 十 方 ( 玉 十 方 帮 
?OO) = Jor++38p7 十 3Hoy0 六 十 3 
十 户 7 十 3.Py7 十 方 yy(073 
= (jur+3jof+3jop 广 + joy 三) 二 万 (fr+2jy7+ 
+3( 瑚 十 方 站 (让 十 放 旋 十 户 ( 天 十 方 用 


(3) 


and, in general， 


(0) 7 = PW DG y(D)， 
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Where P ls the derivative operator 


The approximate numerical solution to the IVP yY'(D = ,yy) over [to,1h] 
is derived by using formula (1) on each Subinterval [ 灰 , 灰 +1]，Thbe general step for 
Taylors method of order N is 


2 3 N 
(5) 1 一 其 十 d 十 2 二 二 7 2 
where di 三 yt ) for j = 三 12,... ,Nateachstep 上 一 0.1...，M 1 

The Jaylor method of order N has the property that the hnal global error (F.G.E.) 
is of the order O(PpN+1D; hence N can be chosen as large as necessary to make this 
error 8S Small as desired. If the order N is fxed, it is theoretically possible to a priori 
determine the step size 六 So that the FEG.E. will be as Small as desired. However 训 
Practice we usually compute two sets of approximations using step Sizes 严 and 严 /2 and 
compare the resujts. 


Theorem 9.6 (Precision of Tayjlor's Method of Order NW). Assume that y(1) is 
the solution to the LVP. If y(D e CNX+I1o,Db] and {( 灰 ， 外] 他 0 is the sequence of 
approximations generated by Taylors method of order N, then 


let| = 1y() 天 [= OCT ， 


(9) N 
|ek+1 = 三 jy7(tD) 次 PT 证) 一 OO). 


In particular the FEG.E. atthe end of the interval will satisfy 
(7) EO(b), 月 =jy( 区 yyU= OU 


The proof can be found in Reference [78]. 
Exampjles 9.8 and 9.9 illustrate Theorem 9.6forthe case N = 4. 址 approximations 
are computed using the step Sizes 六 and 户 /2, we should have 


(8) 尼 (Cy(D) ,有 关 CR4 
for the larger Step Size, and 


(9) (CD sc 和 -Tcn4x LE( (人 ,用 

了 人 
Hence the idea in Theorem 9.6 is that 让 the step size in the Taylor method of order 4 is 
reduced by a factor of 志 the overall F.G.E. will be reduced by about 二 . 
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Example 9.8. Use the Taylor method of order 六 = 4to solvey =( yy)/2on [0,3] 
with y(0) = 1 Compare Solutions for 丑 = 1， 才 了 and 了 

The derivatives of y(1) must first be determined、Recall that the solution >(f) is a 
function of 六 and differentiate the formula y (0) = /Gy(D) with respect to ti to get 
yO(D. Then continue the process to obtain the higher derivatives. 





/ 1 》 
7 了 (= 一， 
20O=( 全 )-: >_1LLD2_ 2 (上 十》 
dt 2 2 2 4 
9 _ df2 t+yVY 0 1+y7 1+4L 2 2+L 》 
? 站 = 订 ( 一 和 = 
qd 2+f NO0+l1 7 1 4 7)/2 2 1! 十 》 
” 0-( 一 人 -一 


To find yl,the derivatives given above must be evaluated at the point (如 , ?0) = (0, 1)， 
Calculation reveals that 


肌 = (0) = 二 一 0.53， 

由 =yO0OD = 全民 一 075 

心 =yG)(0) = 一 = 0.375， 
中 =yG(0) = 一 下 一 0.1875. 


Next the derivatives {dj] are Substituted into (5) with 严 = 0.2$, and nested multiplication 
is used to compnute the value y1: 


yi 一 10+025( 0.5 十 0.25 (至 二 025 ( 0375 055 ( 呈 ))) 


= 0.8974915， 





The computed solution point is (0 , y1) = (0.25, 0.8974915)， 

To determine ?2, the derivatives {dij]} must now be evaluated at the point (0 , y1) 一 
(0.25, 0.8974915). The calculations are starting to require a considerable amount of com- 
putational effort and are tedious to do by hand. Calculation reveals that 


0.25 0.8974915 _ 


di = (0.25) = 一 一 = 03237458， 

中 = y200.25) = 二 = 0.6618729， 

忆 = y9025 - 2.0 十 025 0.8974915 0 3309364 
四 = y74(00.25) = 2 095 十 08974915 _ 0.1654682. 
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Table 9.6 ”Comparison of the Taylor Solutions of Order N = 4fory = (  ， y)/2 
over [0, 3] with y(0) = 王 












Y( 攻 ) Exact 
1.0 














1.0 


















































0.125 0.9432392 0.9432392 
0.25 0.8974915 0.8974908 0.8974917 
0.375 0.8620874 0.8620874 
0.50 0.8364258 0.8364037 0.83064024 0.8364023 
0.75 0.8118696 0.8118679 0.8118678 
1.00 0.8203125 0.8196285 0.8195940 0.8195921 0.8195920 
1.S0 0.9171423 0.9171021 0.9170998 0.9170997 
2.00 1.1045125 1.1036826 1.1036408 1.1036385 1.1036383 
2.S0 1.35953575 1.3S95168 1.3S95145 1.339$144 
3.00 1.6701860 1.6094308 1.6693928 1.6693906 1.6693905 





Now these derivatives {djj are substituted into (5) with 疡 = 0.23, and nested multiplication 
is used to compnute the value y2: 


y2 = 0.8974915 十 os 人 0.32374S8 


0.661872 0.330 . 


一 0.8364037， 


The solution point is (2, y2) = (0.50, 0.8364037). Table 9.6 gives solution values at 
selected abscissas using various step sizes. 四 


卫 xample 9.9， Compare the F.G.E. for the Taylor solutionsto y = (( yy)/2 over [0, 3] 
with y(0) = 1 given in Example 9.8. 

Table 9.7 gives the FEG.E. for these step sizes and shows that the error in the approxi- 
mation y(3) decreases by about 十 when the Step Size is reduced by a factor of 划 


E(y(G3), 月 一 yG3) yw = DO > Ch4， where  C= 0.000614. 国 


The following program requires that the derivatives y ， 罗 ，y ,and yy be saved 
in an M-file named df. For example, the following M-fhile would save the derivatives 
from Example 9.8 in the format required by Program 9.3. 


function z=df(t,y) 
Z=[(t-y)/2 〈2-t+y)/4 (-2+t-y)/8 (2-t+y)/16] ; 
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4SS 


Table 9.7 “Relation between Step Size and F.G.E. for the Taylor Solutions to 


站 = 人 


y)/2 over [0, 3] 








FGE. OUi2) CH4 
Step Number of Approximation Error att! 一 3， where 
Size, 户 steps,，AMf to y(3)，y4h7 y(3)  yYM CC= 0.000614 
1 3 1.6701860 0.0007955 0.0006140 
和 6 1.6694308 0.0000403 0.0000384 
了 12 1.6693928 0.0000023 0.0000024 
24 1.6693906 0.0000001 0.0000001 














Program 9.3 (Jaylor's Method of Order 4)，To approximate the solution of the 


initial value problem y = ,yy) with y(a) = yo over [a, D] by evaluating yy， 
and yand using the Taylor polynomial at each step. 





function T4=taylor (df ,a,b,ya,M) 


XInpPut - df=[y” y?， yy ] entered as a string df， 
X where y'=f(t,y) 


名 -~ a and b are the Left and Tight end points 

% - ya is the initial condition y(a) 

从 - M is the number of steps 

MOutput - T4=[T: Y?] where T is the vector of abscissas and 
炙 Y is the Vector of ordinates 

h=(b-a)VM; 


T=zeros (1 ,M+1) ; 

Y=zeros (1 ,M+1) ; 

T=a:bh:b; 

Y(1)=yai 

for j=1:M . 
D=feval(df ,T(j),Y(j)) ; 
Y(Jj+1)=Y(j)+hyk(D(1)+hr(D(2)/2+hx(D(3)/6+h+rD(4)V/24) ) ) ; 

enad 

T4=[T，Y?] ; 


卫 xercises for Taylor Series Method 


Te | 


In Exercises 1 through $ solve the differential equations by Taylors method of order N = 4. 
(a) Let = 0.2 and do four steps by hand caiculation. Then let 疡 = 0.2 and do two 
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steps by hand calculation. 
() Compare the exact solution y(0.4) with the two approximations in part (a). 
(c) Does the 下 G.E. in part (a) behave as expected when Pis halved? 


1 Y= 并 ywithy(0) =1yD== e+b2 2 二 2 


2. 允 =37 二 3twithyO)=1LyD= 


3.y= 1withy(0)=1yGD=e 0 


4.7=e2 27withy(0) 王 看,y(D) = 而 e 十 ie 


5. 多 = 21y2 with y(D) = 1 y 四 一 1 DO 


6 The Richardson improvement method discussed in Lemma 7.1 (Section 7.3) can be 
used in conjunction with Taylors method，If Taylors method of order N = 4i 
used with step size Pthen y(b) 祥 萝 十 CHp4. Taylors method of order N 一 4js 
used with step Size 2, then y(b) S J21 十 16C1 .The terms involving Chp4 can be 
eliminated to obtain an improved approximation for y( 思 ): 


167j yo 


7) 关 一 和 


This improvement scheme can be used with the values in Example 9.9 to obtain better 
approximations to y(3). Find the missing entries in the table below. 









(16y 





J2j)715 








1.0 1.6701860 
0.5 1.6694308 
0.25 1.0693928 


1.6693906 





7. Show that when Taylors method of order N is used with step Sizes 彤 and 关 /2, then 
the overall FEG.E. will be reduced by a factor of about 2 w for the smaller step Size. 


生 


Show that Taylor's method fails to approximate the solution y(1) = 13/2 of the LVP 


y = jy) = 1.5y13 with y(0) = 0. Justify your answer What diftficulties were 
encountered? 
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9.(a) “Verify that the solution to the LVP y' = 72， y(0) = 1 over the interval [0, 1) is 
y(D) 三 1 力 . 
(b) Verify that the solution to the LVP y = 1 十 只, y(0) = 1 over the interval 
[0,r/4) isy(b 一 tan(t 十 并/4). 
(cj) Use the results of parts (a) and (b) to argue that the solution to the LVP y = 
妃 十 思 , y(0) = 1has a vertical asymptote between 交 /4 and 1. (Its location is 
neart 一 0.96981.) 
10. Consider the VP y = 1 + 2, y(0) = 1. 
(a) ”Find an expression for yC2)(0D，yG)(D)，and y(4)(D). 
(b) Evaluate the derivatives att = 0, and use them to find the first five terms in the 
Maclaurin expansion for tan(1). 


Algorithms and Programs 





In Problems lthrough S$ solve the differential equations by Taylor's method oforder N = 4. 


(a) Let 有 = 0.1 and do 20 steps with Program 9.3. Then let 户 = 0.05S and do 40 steps 
with Program 9.3， 

(b) Compare the exact solution y(2) with the two approximations in part (3). 

(cj) Does the EG.E. in part (a) behave as expected when AP is halved? 

() Plot the two approximations and the exact solution on the Same coordinate system. 
了 int. The output matrix T4 from Program 9.3 contains the x and y coordinates of 
the approximations. The commandPlot(T4(: ,1) ,T4(: ,2)) will produce a graph 
analogous to Figure 9.6. 

.多 一 帮 ywithy(OD) =1yD = e+ 2+2 

.多 =37 十 3 with y(0D) =1LyO = 和 Se 1 乞 

.y= bwithyO=1TyD=e 202 

7=e2 2ywithy(0) 一 下， y() 王 而 e 委 十 te 

.多 =2172 with y(0) 一 ly 人 =1( 1) 

。(3) “Write a program to implement the Richardson improvement method discussed 

in Exercise 6. 

(b) Use yourprogram from part (a) to approximate y(0.8) fortheIVP y = 纪 十 ?2， 
y(0) = 1 over [0, 0.8], The tmue solution at ! = 0.8 is known to be y(0.8) 二 
5.8486168. Start with the step size 户 = 0.0$. The program should terminate 


when the absolute value of the difference between two consecutive Richardson 
improvementsis < 10 6. 


全 山本 由 
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7. (a]) Modify Program 9.3 to carry out Taylor's method of order N = 3. 
(Use your program from part (a) to solve the IL.VP 交 二 弓 十 y2， y(0) = 1 over 
fo, 0.8]. Find approximate solutions for the step sizes 疡 王 0.05, 0.025, 0.0125， 
and 0.0062S. Pilot the four approximations on the same coordinate system. 


Runge-Kutta Methodqgs 


The Taylor methods in the Preceding Section have the desirabjle feature that the FEG.E. 
is of order OCRN ), and N can be chosen large so that this error is small. However the 
Shortcomings of the Taylor methods are the a priori determination of N and the com- 
putation of the higher derivatives, which can be very complicated. Each Runge-Kutta 
method is derived from an appropriate Taylor method in such a way thattheFG.E.is of 
order O(pAw). Atrade-off is made to perform several function evaluations at each Step 
and eliminate the necessity to compute the higher derivatives. These methods can be 
constmcted for any order N. TheRunge-Kutta method of order N = 4is most popular 
Lis a good choice for common purposes because it is quite accurate, stable, and easy 
to program， Most authorities proclaim that it is not necessary to go to a higher-order 
Imethod because the increased accuracy is offset by additional computational effort. 下 
Imore accuracy is required, then either a smaller step size or an adaptive method should 
be used. 

The tfourth-order Runge-Kutta method (RK4) simulates the accuracy of the Tayler 
series method of order N = 4. The method is based on computing 了 +1 as follows: 


(DJ) WHILE 一天 十 WII 十 由 2 妃 十 芭 耻 十 芭 属 ， 
where 后 ,1 必 ,所 and 对 4 have the form 


大 三 AAA, 区)， 

刀 三 路 (不 十 QI 其 十 六 IKI)， 

1 三 站 ( 帮 十 aa1 天 十 DoK 十 bp3 恕 )， 

14 三 有 站 ( 庆 十 a3 有 次 十 D4K 十 D5 避 十 2613). 


(2) 


By matching coeffcients with those of the Taylor series method of order N 一 4 so that 
the local truncation error is of order O (15)， Runge and Kutta were abjle to obtain the 
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following system of equations: 


六 1 一 1， 

2 二 p3 = 02， 

pb4 十 25 十 26 = 三 03， 

1 十 2 十 2 十 由 二 上， 


W241 十 342 十 W443 二 5 
2a7 十 103G2 十 403 一 了， 
G9) 2aT 十 3d3 十 4d3 一 7， 
W3G1203 十 W4(Q105 十 4226) 一 5， 
W3G102D3 十 W443(41D5 十 0206) 一 5 
wa3a1p3 十 U4(a1b5 十 a2b6) 一 二 
U4a1p3256 一 元 


The system involves 11 equations in 13 unknowns. Two additional conditions must be 
Supplied to solve the System, The most useful choice is 


(4) 41 一 


1 1 1 

C2 王 二， 43 一 1， 忆 1 一 一 ， 2D3 一 二 ， 2D4= 0， D5s= 0， 26 = 1， 
孔 | 1 1 划 1 
一 一 ，UW2 一 一 ， 一 一， 一 一 。. 
人 


The values in (4) and ($) are substituted into (2) and (1) to obtain the formaula for 
the standard Runge-Kutta methodqd of order N 三 4, which is stated as follows. Start 
with the initial point (加 ,70) and generate the sequence of approximations using 


庆 ( 记 十 2 户 十 2 户 十 用 ) 


(0) +1 三 其 十 5 ， 
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Where 
万 = 太 ，y)， 


天 闵 
户 -7 (A++ 
(7) 


万 疡 
户 = 了 (w+ 生 二 二 入) ， 
及 三 了 让 十 及 次 十 瑚 户 ). 


Discussion about the Method 


The complete development of the equations in (7) is beyond the scope of this book and 
can be found in advanced texts, but we can get Some insights， Consider the graph of 
the solution curve y 一 (1) over the first subinterval [10, 癌 ]. The function values in 
(7) are approximations for Slopes to this curve. Here 万 is the Slope at the lett 户 and 
are two estimates for the slope in the middle, and 太 is the slope at the right (see 
Figure 9.9(a)). The next point (1 yi) is obtained by integrating the slope function 


(8) y(ID) >o= 上 (GyY(D) dt 
加 


I Simpson's rule is applied with step size P/2, the approximation to the integral 
in (8) is 


红 严 ， 
G9) 1/ jyO)dis Go yo)+47Gup yu) + y(GD)， 
加 


Where /2 is the midpoint of the interval. Three function values are needed; hence we 


make the obvious choice (lo, y (to)) 三 几 and Fn y()) 之 万. Forthe valuein the 
Imiddle we chose the average of 户 and 方 : 


2 十 方 
JU2， 7y(012)) 六 2 也 
These values are substituted into (9), which is used in equation (8) to get yl1: 


(10) 站 + 入) 


When this formula is simplified, it is seen to be equation (6) withK = 0. The graph 
for the integral in (9) is shown in Figure 9.9(b). 
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?= 了 ( 办 (0， 7y(0D)) 


了 
如 








(to, 亡 ) 
(na 亡 ) 


、。 


(2 万 ) 





(及 ， 万 ) 
1 
10 1172 厂 10 112 
(a) Predicted Slopes mij (9 the (b) Integral approximation: 


。 - 疡 
Solution Curve y》 = y(D) y() -2 加 = 5 + 2 户 + 2 万 + 力 ) 


Figure 9.9 ”The graphs 》 一 7(D) andz = jy()) in the discussion of the Runge-Kutta 
method of order N = 4， 

Step Size versus Error 

The error term for Simpson's rule with step size 肠 /2 is 
态 5 

2880- 


下 the only error at each step is that given in (1l), after M steps the accumnulated error 
for the RK4 method would be 





(11) ycl) 


(12) wb 和 wa Oo1s OO 
全 ”80 57607 


The next theorem states the relationship between FEG.E. and step size. It is used 


to give us an idea of how much compnuting effort must be done when using the RK4 
method. 


Theorem 9.7 (Precision of the Runge-Kutta Method). Assume that y() is the 
solution to theVP If y(D) e C5[10,D] and {( 厌 ， y)] 寻 0 is the sequence of approxi- 
Imations generated by the Runge-Kutta method of order 4, then 

et = ly00 = Oo， 


(13) 5 
jek+1 三 |y(k+D 次 PN 一 OO)， 
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In particular, the FG.E. at the end of the interval will satisfy 
〈14) EO(G), 阅 一 ly yd= 0O(0. 


Examples 9.10 and 9.11 illustrate Theorem 9.7. I approximations are computed 
using the step Sizes 玉 and 产 /2, we Should have 


(15) 巨 (y(D) Js CR4 
for the larger step size, and 
玉 hn4 1 1 
玉 (yD, 二 1]>C 一 = 一 CJ4s 一 FUy(D, 门 . 
(16) (x ) 3 ) 5 165C 让 (y( 思 ,万 ) 


Hence the idea in Theorem 9.7 is that ifthe step size in the RK4 method is reduced by 
afactor of 1 we can expect that the overall FG.E. will be reduced by a factor of 吉 . 


了 Example 9.10. Use the RK4 method to solve the LVP Y = (4 /2 on [0,3] with 
7y(0) = 1. Compare solutions for 产 一 1， 序 于， and 攻 

Table 9.8 gives the solution values at Selected abscissas. For the step Size 尹 一 0.2$, a 
Sample caiculation is 


_ 00 10 


万 本 二 05， 
户 二 7 = “0.40625， 
及 一 人 = “0.4121094， 
六 一 1 一 “0.3234863， 
= 10 十 0.25 人 
= 0.8974915. ， 


Example 9.11. Compare the FG.E. whenthe RK4 methodis usedtosolvey = (f 力 /2 
overf0, 3] with y(0) = 1 using step sizes 1， 革 ， 下 and 去 

Table 9.9 gives the 下 G.E. for the various step sizes and shows that the error in the 
approximation to y(3) decreases by about 吉 When the step Size is reduced by a factor 
of hl. 


FE 站 =yG3) =O = Chi4 whereC = 0.000614. 


A comparison of Exampjles 9.10 and 9.11 and Examples 9.8 and 9.9 shows what is 
Ineant by the statement “The RK4 method simulates the Taylor series method of order 
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Tabile 9.8 ”Comparison of the RK4 Solutions with Different Step Sizes for y 一 (人 /2 
over [0, 3] with y(0) = 1 






y( 帮 ) Exact 
1.0 













1.0 


































0.123 0.9432392 0.9432392 
0.25 0.8974915 0.8974908 0.8974917 
0.375 0.8620874 0.8620874 
0.50 0.8304258 0.8304037 0.8364024 0.8364023 
0.75 0.8118696 0.8118679 0.8118678 
1.00 0.8203125 0.81906285 0.8195940 0.8195921 0.8195920 
1.50 0.9171423 0.9171021 0.9170998 0.9170997 
2.00 1.1045125 1.1036826 1.1036408 1.1036385 1.1036383 
2.50 1.3395575 1.3$95168 1.3595145 1.3595144 

1.6701860 1.66094308 1.6693928 1.6693906 1.6693905 














Table 99 Relation between Step Size and REG.E. for the RK4 Solutions to 
y=( 人 yy)/2overf0,3] with >(0) = 1 














上 G.E. 
Approximation Error at! = 3， 


to y(3)，yM y(G3) yd 


O(84) = CH4 
where 
C = 0.000614 









Number of 
Steps, AI 


Step 
SiZe, 天 








1.6701860 0.0007955 


和 6 1.6694308 0.0000403 0.0000384 


了 12 1.6693928 0.0000023 0.0000024 








1.6093906 0.0000001 








AN =4”Forthese examples,the two methods generate identical solution sets {( 灰 ,从 锯 
over the given interval. The advantage of the RK4 method is obvious; no formulas for 
the higher derivatives need to be computed nor do they have to be in the program. 

It is not easy to determine the accuracy to which a Runge-Kutta solution has been 
computed. We could estimate the size of y 人 (c) and use formula (12). Another way 
is to repeat the algorithm using a smaller step size and compare results. A third way is 
to adaptively determine the step size, which is done in Program 9.5. In Section 9.6 we 
will see how to change the step size for a multistep method . 


Runge-Kutta Methods of Ordqder N 一 2 


The second-order Runge-Kutta method (denoted RK2) simulates the accuracy of the 
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Taylor series method of order 2，Although this method is not as good to use as the 
RK4 method, its proof ls easier to understand and llustrates the Principles involved. 
To starb we Write down the Taylor series formula for y(f 十 及 ): 


1 
(17) yG 十 站 = y(GD) 十 py 十 5 入) 七 CT 站 十 ， 


Where C7 is a constant involving the third derivative of y(O) and the other terms in the 
series involve powers of ij for j > 3. 

The derivatives y (0 and y() in equation (17) must be expressed in terms of 
ty) and its partial derivatives. Recall that 


(18) y CD = 7 7). 


The chain rule for differentiating a function of two variables can be used to differ- 
entiate (18) with respect to 1 and the result is 


?7 D 三 万 作 妨 二 廊 ( 作 7 
Using (18), this can be written 
(19) 多 人 = 万 ( 妨 十 万 ( 人 7) y)， 
The derivatives (18) and (19) are substituted in (17) to give the Taylor expression 


for y(f 十 户 ); 


1 
yCG 十 站 一 y(D) 十 Ap ) 十 了， 妇 
020) 


1 
十 5 入 方 (， 轨 FG, 信 二 Cr 了 十. 


Now consider the Runge-Kutta method of order N 三 2, which uses a linear com- 
bination of two function values to express y(f 十 万): 


(2D1) y( 十 六 = 十 40 二 BA 广 ， 
Where 
(22) 力 = 太 (， y)， 


刻 =JUC+ Ph y+OCR0). 
Nextthe Taylor polynomial approximation for a function of two independent vari- 


ables is used to expand 丰 (, y) (see the exeicises)，This gives the following represen- 
tation for 方 : 


(23) 户 三 70 们 二 PRF 坟 上 CQR 记 DA 信 十 CPp 到 十， 
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where CP involves the second-order partial derivatives of 让 (4, y)， Then (23) is used 
in (21) to getthe RKR2 expression for y( 十 万 ): 


yG 十 阳 一 y(D) 十 (4 十 BRFd 人 十 互 PR2 廊 (人 


(24) ， f 
十 BC 方才 7G 信 十 BCPp 庆 十 


A comparison of similar terms in equations (20) and (24) will produce the follow- 
ing conclusions: 


jj 一 (4 十 嘱 ) 天 Pt y) implies that1 王 4 十 也 


1 1 
5 户 几 妨 王 有 PH implies that 了 = BP， 


1 1 
5 广 (， yj 六 =BO1 太 yy) implies that = BO. 


Hence, f we require that 4, B,，P,and CO satisfy the relations 
(25) 4 十 万 = 上 刁 忆 三 


then the RK2 method ip (24) will have the same order of accuracy as the Taylor's 
method in (20). 

Since there are only three equations in four unknowns, the system of equations (25) 
is underdetermined, and we are permitted to choose one of the coefficients. There are 
Several special choices that have been studied in the literature; we mention two of them. 

Case (四 Choose 4 一 世 This choice leads to 妃 一 世 PP=lande=1. 下 
equation (21) is written with these parameters, the formula is 


忆 
(20) yG 十 月 三 y(D 十 (Cj 人 十 太 y7 十 Ad y)))7， 


When this scheme is used to generate [( 灰 , 共 )}, the result is Heun's method. 
Case ( 训 Choose 4 = 0. This choice leadsto 8 = 1 已 = 区 andQ@= 二 下 
equation (2]) is written with these parameters, the formula is 


忆 忆 
(27) y(Lf 十 六 一 y( 人 0 十 F (+37c 


When this scheme is used to generate {( 丰 , 六) itis called the modifjied Euler-Coxcjy 
111e 态 od. 
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Runge-Kutta-Fehlberg Method (RKF4S) 


One way to guarantee accuracy in the solution of an [LV.P is to solve the problemtwice 
using step sizes 刀 and AP/2 and compare answers at the mesh points corresponding to 
the larger step Size，But this requires a _ significant amount of computation for the 
smaller step Size and must be Tepeated if it is determined that the agreement is not 
good enough. 

The Runge- 开 utta-Fehlberg method (denoted RKF45) is one way to try to resolve 
this problem. It has a procedure to determine if the proper Step size jis being used, At 
each step, two different approximations forthe solution are made and compared. If the 
two answWers are in Close agreement, the approximation is accepted. If the two answers 
do not agree to a specified accuracy, the step size is reduced. If the answers agree to 
more Significant digits than required, the step size is increased. 

Each step requires the use of the following six values: 


K1 一 天 三 (大 7)， 

1 1 
已 一 Prli 一 疡 ， 一 大 |， 
2 (w+ w+ 和 


3 3 9 
天 一 大 一 瑚 ， 一 天 一 天 》 
3 jw 闪 + 到 所 十 到 双 】 


(28) 12 1932 ”7200， 7296 
jj (大 十 地 记 闪 十 二 有 二 一 证 一 一 及 ， 
1/ ( 十 语 关 十 597 和 开 呆 名 十 3) 


439 3680 84S 
一 大 忆 ， 一 -一 大 8K 一 一 一 天 一 一 一 
1 1 (+ 冰 十 6 1 2 十 ET 4 


好 


1 8 3544 1859 11 
中 三 Ar 不 十 二 六， 二 如 二 202 一 一 一 /5 | . 
6 (+ 2 5 二 有 有 04 公 5) 
Then an approximation to the solution of the [LVP is made using a Runge-Kutta 
method of order 4: 


1408 2197 ] 
2 人 一 一 -天 一 
(29) 了 +l 三 + 二 1 十 655 局 十 下 0 公 565， 
where the four function values 站 万 ， 户 and 方 are used. Notice that 户 is not used 
in formula (29)，A better value for the solution is determined using a Runge-Kutta 
method of order 3: 

16 665S6 28,561 9 2 

30 三 凑 十 一 -KiL 十 一 一 一 让 十 一 一 1 一 后 十 二 后 . 
CC) 1 25343043 有 055 瑟 5 


The optimal step Size sj can be determined by multiplying the scalar y times the 
Current Step Size 疡 . The scalar y js 


1/4 1/4 
GD := 人 ( Tol 肠 ) ~084( .Tolp ) 


2|zk+H1 区 +H |zx+1 其 + 
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Table 9.10 ”RKF45 Selution to 多 = 1+y2,y(0O =0 
















































RK43S approximation True solution， Error 
大 大 凑 (kk) = tan( 基 ) ?(K) 也 
0 0.0 0.0000000 0.0000000 0.0000000 
1 0.2 0.2027100 0.2027100 0.0000000 
2 0.4 0.4227933 0.4227931 0.0000002 
3 0.6 0.6841376 0.6841368 0.0000008 
4 0.8 1.0296434 1.0296386 0.0000048 
5 1.0 1.5S74398 1.S774077 0.0000321 
6 1.1 1.9648085 1.9647597 0.0000488 
7 1.2 2.3722408 2.$721516 0.0000892 
8 1.3 3.6023295 3.6021024 0.0002271 
9 1.35 4.4355714 4.4552218 0.0003496 
10 1.4 S.798S045 S.7978837 0.0006208 








where Tol is the specified error control tolerance. 

The derivation of formula (31) can be found in advanced books on numerical anal- 
ysis. It is important to learn that a fixed step size is not the best strategy even though 
it would give a nicer appearing table of values. If values are needed that are not in the 
table, polynomial interpolation should be used. 


Example 9.12， Compare RKF45 and RK4 solutions to the LVP 
7=1+ 六 with y(00)=0 on [0,1.4]. 
An RKEF45 program was used with the value Tol = 2 x 10 5 for the error control 
tolerance. It automatically changed the step size and generated the 10 approximations to 
the solution in Table 9.10. An RK4 program was used with the a priori step size of 疡 一 0.1， 


Which required the computer to generate 14 approximations at the equally spaced Points in 
Table 9.11. The approximations at the right end point are 


y(1.4) yio = $.7985045 and yy(1.4) sy14 = 5.7919748 
and the errors are 
忆 10 三 0.0006208 and FEI4 =0.0039089 


for the RKF45 and RK4 methods，respectively， The RKF45 method has the smaller 
errOT. 四 
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Table 9.11 “RK4 Solution to 交 =1+yY,y(O =0 


True soiution， Error 
y( 丰 ) = tan( 基 ) 


、 0.0000000 0.0000000 
0.1003346 0.1003347 0.0000001 
0.2027099 0.2027100 0.0000001 
0.3093360 0.3093362 0.0000002 
0.4227930 0.4227932 0.0000002 
0.5463023 0.S463025 0.0000002 
0.6841368 0.6841368 0.0000000 
0.8422886 0.8422884 0.0000002 
1.0296391 1.0296386 0.0000005 
1.2601588 1.2601582 0.0000006 
1.S374064 1.$$74077 0.0000013 
1.9647466 1.9647597 0.0000131 
2.3720718 2.37215106 0.0000798 
3.6015634 3.6021024 0.0005390 
5.7919748 5.7978837 0.0059089 











Program 9.4 (Runge-Kutta Method of Order 4). To approximate the solution 


of the initial value problem y = 矿 (, 六 with y(a) = yo over [a,b] by using the 
formula 





天 
了 居 +1 一 凑 十 站 十 2K2 十 213 十 局 ). 





function R=rk4(f,a,b,ya,M) 


%Input - ff is the function entered as a String ) 工 ， 

人 - a and b are the left and Tight end points 

X% - ya is the initial condition y(a) 

从 - M is the number of steps 

youtput - R=[T' Y'] where T is the vector of abscissas 
人 and Y is the vector of ordinates 

h=(b-a)VM; 


T=zeros (1 ,M+1) ; 

Y=zeros (1 ,M+1) ; 

T=a:h:b; 

Y(CL)=ya; 

for j=1:M 
Kil=h*feval(f,T(j),Y(j)) ; 
k2=h*yfeval(f ,T(j)+h/2,Y(j)+k1/2) ; 
Kk3=h*feval(f,T(j)+h/2,Y(j)+Kk2/2) ; 
Kk4=h*feval(f,T(j)+h,Y(j)+k3) ; 
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Y(j+1)=Y(j)+(k1+2*#Kk2+2*K3+K4)V6; 
end 
R=[T” Y] ; 


JTJhe following program implements the Runge-Kutta-Fehlberg Method (RKF45) 
described in (28) through (31). 










Program 9.5 (Runge-Kutta-Fehlberg Method (RKEF45)). To approximate the 
solution of the initial value problem y = jy) with y(a) 一 yo over [Ce,p] with 
an error Control and step-size method. 






function R=rkf45(f,a,b,ya,M,tol) 


%hInput - 了 is the function entered as a StTing 了) 

攻 - a and b are the left and right end points 

双 - ya ie the initial condition y(a) 

久 - M is the number of steps 

久 -~ tol is the tolerance 

XhOutput - BR=[T，Y'] where T is the vector of abscissas 
从 and Y is the vector of ordinates 


khEnter the coefficients neceSSary to calculate the 
%Mvalues in (28) and (29) 
a2=1/4;b2=1/4;a3=3/8;b3=3/32;c3=9/32;a4=12/13， 
b4=1932/2197 ; c4=-7200/2197;d4=7296/2197;a5=1; 
b5=439/216j;c5=-8;d5=3680/513;e5=-845/4104;a6=1/2; 
b6=-8/27;c6=2;dq6=-3544/2565;e6=1859/4104; 
tf6=-11/40;rl=1/360;r3=-128/4275;r4=-2197/75240;r5=1/50， 
r6=2/55;n1=25/216;n3=1408/2565;n4=2197/4104;n5=-1/5; 
big=lel15; 
h=(b-a)V/M; 
hmin=h/64; 
bmax=64*h ; 
max1=200 ; 
Y(1)=ya; 
T(1)=aj 
]j=1; 
br=b-0.00001*abs (b) ; 
while (T(j)<b) 

if 〈(T(j)+h)>br) 

h=b-T(j) ; 

end 

4hCalculation of values in (28) and (29) 

kil=h*yfeval(f,T(j),Y(j)); 

y2=Y(j)+b2*xkl; 
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zf big<abs(y2)break ,end 
X2=h#kfeval(f ,T(j)+a2xh,y2) ; 
y3=Y(j)+b3*Kk1+c3*+rK2 
if big<abs (73)break ,end 
K3=h*+*feval(f ,T(j)+a3*kh,y3) ; 
y4=Y(]j)+b4*Kk1+c4#+K2+d4*+K3 ; 
if big<abs(y4)break ,end 
Kk4=hkfeval(ft,Y(j)+a4+kh,y4) ; 
y5=Y(j)+b5*K1+c5*#kk2+d5*K3+e5+Kk4; 
if big<abs(y5)break ,end 
K5=h#feval(f,T(j)+a5+*h,y5) ; 
y6=Y(j)+b6*k1+c6*k2+d6#kk3+e6*xk4+f6*+k5 ; 
if big<abs(y6)break ,end 
Kx6=h*yfeval(f,Y(j)+a6*h,y6) ; 
erTr=abs(T1#K1T+T3*yK3S+T4YK4+T5*K5+r6+Kk6) ; 
ynew=Y(]j)+Dn1L1*Kl+n3+K3+n4*K4+n5*K5 ; 
YError and step 8ize control 
itf((err<tol) | (h<2*hmin) ) 

Y(j+1)=ynew; 

ift(CT(j)+h)>br) 

T(j+l)=b; 
elSse 
T(j+1)=T(Gj)+h; 

end 

j=j+1; 
end 
if (erzr==0) 

S=0 ; 
else 

sS=0.84* (上 olLxh/err) (0.25) ; 
end 
if((s<0.75) 名 (h>2*hmin) ) 

h=h/2; 
end 
if((s>1.50) 妇 (2+h<hmax) ) 
Ph=2*xh ; 
end 
if((big<abs(Y(j)))1 (max1l==j)) ,break,end 
M=j ; 
if (b>T(j)) 

M=j+1; 
elSe 

M=Jj; 
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end 
R=[T2 Y7]; 


Exercises for Runge- 玉 utta Methods 





In Exercises 1 through $, solve the differential equations by the Runge-Kutta method of 
order N 一 4. 


(a) Let 屎 = 0.2 and do two steps by hand calculation. Then letA = 0.1 and do four 
steps by hand calculation. 

(b) Compare the exact solution y(0.4) with the two approximations in part (a). 

(c) Does the 上 G.E. in part (a) behave as expected when Pis halved? 

1. Y= 弓 ywithy(0) 王 ly 一 ef: 二 训 2r 十 2 


2. y=3y+3twithy(OD 一 1yD 一 Se 了 


3.y= 四 withy0)=1yD=e 2 

4 了 =e2 2ywithy(O) = 而,y( 人 一 击 e 辣 十 ie 天 

S. 多 =2172 with y(0) = 1yO=10 0) 

6. Show that when the Runge-Kutta method of order N = 4 is used to solve the LVP 
关 = fy over [ab with y(a) = 0theresult is 


六 M_ 1 
7 一 二 记 CD +47Ukrl2) 十 7GkrD)， 


where 及 = (aq/M,and 庆 一 G 十 有 andtil2 一 十 人 十 坝 忆 which is 


Simpson's approximation (with Step size 关 /2) for the definite integral of 矿 ( 人 ) taken 
over the interval [a, D]. 


7。The Richardson improvement method discussed in Lemma 7.1 (Section 7.3) can be 
used in conjunction with the Runge-Kutta method， If the Runge-Kutta method of 
order N 一 4is used with step size 有 ,we have 


y( 切 全 鞠 十 Cj 
开 the Runge-Kutta method of order 入 王 4 is used with step size 2j, we have 
y(D) sy22 十 CR 


The terms involving Chn4 can be eliminated to obtain an improved approximation for 
y(p), and the result is 


167 3y26 


P) 之 
y(D) 厂 
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This improvement Scheme can be used with the values in Example 9.11 to obtain 
better approximations to y(3). Find the missing entries in the table below. 









(16) 关 21VA1S 






1.6701860 
1.0094308 
1.6693928 







1.6693906 


For Exercises 8 and 9, the Taylor polynomial of degree N = 2 for a function ty) of two 
variabjles x and yexpanded about the point (C, 2) is 


忆 人 7y) = ap 二 Ta DLL aq+ 记 ap D) 
Je DG GD? ya, DO 站 ? 
+ 一 一 一 一 一 一 一 ， 


+ jp aq 切 十 5 


8. (a) Find the Taylor polynomial of degree N = 2 for Fl y) = y/t expanded 
about (1, 1). 
(bp) Find 疡 (1.0$, 1.1) and compare with 六 1.0S, 1.1). 
9 (a) Find the Taylor polynomial of degree N = 2 for ft, 人 二 (+ 72 
expanded about (0, 0). 
(p) Find 忆 (0.04, 0.08) and compare with F(0.04, 0.08). 


Algorithms and Programs 
er | 


In Problems 1 through 5$, solve the differential equations by the Runge-Kutta method of 
order N 一 4. 


(a) Let 严 三 0.1 and do 20 steps with Program 9.4. Then let 户 = 0.05 and do 40 steps 
with Program 9.4. 

(b) Compare the exact solution y(2) with the two approximations in part (a). 

(c) Does the F.G.E. in part (a) behave as expected when Pis halved? 

《dq) Plot the two approximations and the exact solution on the same coordinate system. 
瑟 nt The output matrix R from Program 9.4 contains the x and ycoordinates of 
the approximations，The command plot(R(: ,1) ,R(:,2)) will produce a graph 
analogous to Figure 9.6. 

1 y 王妃 ywithy(O0) =1yOD = e+5 2 十 2 


2. 一 37+3twithyO) 一 1y7D 一 ge 7 
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3.yY = 上 withy0)=1yGO 一 e 2 
2 2y with y(0) 一 下 ， y() 一 古 e 生 十 te 半 
S$. y = 21y2 with y(0) = 1 yd) = 174 妇 ) 


In Problems 6 and 7, solve the differential equations by the Runge-Kutta-Fehlberg method. 


4. 多 一 e 


(a) Use Program 9.9 with initial step size 瑚 =0.1 andtol = 10 7 

(人 b) Compare the exact solution y(2) with the approximation. 

(c) Plot the approximation and the exact solution on the same coordinate System. 
6. Y = 91e3t y(0) =0over[0,3]y( =3te3 es3t+l 

7. YY =2tan 1),y(0) =0over[0,1],y() =2ttan 100 ln(l 十 D2) 


8. In a chemical reaction, one molecule of A combines with one molecule of B to form 
one molecule of the chemical C. It is found that the concentration y(t) ofC at time ! 
is the solution to the V.P, 


y=kKa 7 )) with 7(0)=0， 


Where is a positive constant and wa and p are the initial concentrations of A and 
B, respectively. Suppose that 上 一 0.01, a = 70 millimoleyliter and 一 S0 mil- 
limoles/liter Use he Runge-Kutta method of order N = 4 with 天 =0.5to find 
the solution over [0, 20]. RemarKk, You can compare your compnuter solution with the 
exact solution y() = 350(1 8e 020)/1(7 Se 020. Observe that the limiting value 
is S0 as ! 一 十 Co, 


9. By solving an appropriate initial value problem, make atable of values of the function 
JJ given by the following integral: 
fo= + -天 人 rdt for0<xr<3 
X) 一 一 十 一 二 上 Qr X 。 
2 27 0 可 


Use the Runge-Kutta method of order N = 4 with 产 = 0.1 for your computations. 
Your solution should agree with the values in the following table， Remark. This is & 
good way to generate the table of afeas for a standard normal distribution. 










0.5 


0.6914625 
1.0 | 0.8413448 
1.5 | 0.9331928 
2.0 | 0.9772499 
2.5 | 0.9937903 


0.9986501 
10. (a) ”Write a program to implement the Richardson improvement method discussed 
in Exercise 7， 


(bp) Use yourprogram from part (a) to approximate y(0.8) fortheIL.VP y = 弓 十 刀 ， 
y(0) = 1 over f0, 0.8]. The true solution at ! = 0.8 is known to be y(0.8) 一 
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5.8486168.， Start with the step Size 岂 三 0.05. The program should terminate 
when the absolute value of the difference between two consecutive Richardson 
improvementsis < 10 7. 


11L，Consider the first-order integro-ordinary differential equation: 
了 
多 一 13y 0.2$y? 00001y / y(rJ dr. 
0 


(a) Use the Runge-Kutta method of order 4 with 三 0.2, and y(0) = 250 over the 
interval [0, 20], and the trapezoidal rule to find an approximate solution to the 
equation (See Problem 10 in the Algorithms and Programs in Section 9.2). 

(b) Repeat part (a) using the initial values y(0) = 200 and y(0) = 300. 

(OPlot the approximate solutions from parts (a) and (b) on the same coordinate 
System ， 


Predictor-Corrector Methods 


The methods of Euler Heun, Taylor and Runge-Kutta are called simglie-step mae 纺 ods 
because they use only the information from one previous point to compnute the suc- 
Cessive point; that is, only the initial point (f, yo) is used to compute (f, y1) and， 
in general，W is needed to compute +1，After several points have been found, it 
is feasible to use several prior points in the calculation. For iustration, we develop 
the Adams-Bashforth fourstep method, which requires 次 3, 区 2 次 1 and in 
the calculation of +1，This method is not self-starting; four initial points (10，y0)， 
Gy) (2 y72), and (3 3) must be given in advance in order to generate the points 
{(, Wr) :大 之 4 

A desirable feature of a multistep method is that the local truncation error (L.TE.) 
can be determined and a correction term can be inclauded, which improves the accuracy 
of the answer at each step. Also, it is possible to determine if the step size is small 
enough to obtain an accurate value for X+1, yet large enough so that unnecessary and 
time-consuming calculations are eliminated，Using the combinations of a predictor 
and corrector requires only two function evaluations of F(, y) per step， 


The Adams-Bashforth-Moulton Method 


The Adams-Bashforth-Moulton predictor-corrector method is a multistep method de- 
rived from the fundamental theorem of calculus: 


下 +1 
( ytD) = yGD 二 上 ds y(D)dt 
大 
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z = 帮 f 7CD) z= 帮 4 ynD) 
1 1 AL Vi 1N3 和 丰 了 tl 
(a) The four nodes for the (a) The four nodes for the 
Adams-Bashforth predictor Adams-Moujlton corrector 
(extrapolation is used). (interpolation is used). 


Figure 9.10 Integration over [ 杂 , 灰 ij in the Adams-Bashforth method. 


The predictor uses the Lagrange polynomial approximation for F(t, y(D) based 
on the points ( 克 3 大 3) (不 2 六 20( 大 Dand(, 大 ).Itis integrated over 
the interval [大 , 大 +H in (1). This process produces the Adams-Bashforth predictor: 


万 
(2) Phk+1 三 傣 十 世人 9 庆 3+37 庆 2 59 扩 1 二 355 六 ). 


The corrector is developed similarly，The value Pk+l just computed can now be 
used. A second Lagrange polynomial for FGt, y(1)) i8 constructed，which is based 
on the points ( 2, 大 2)，( 丰 1 大 D，(, 所 )， and the new point (1 大 FT 一 
(x+ (+ PE+D). This polynomial is then integrated over [ 灰 , 灰 +1] producing the 
Adams-Moulton corrector: 


严 
(3) yk+1 三 其 十 世 ( 大 2 5S$ 庆 1 二 19 庆 十 9 大 + 1)， 


Figure 9.10 shows the nodes for the Lagrange polynomials that are used in developing 
formulas (2) and (3), respectively. 


了 rror Estimation and Correction 


The errorterms forthe numerical integration formulas used to obtain both the predictor 
and corrector are of the order 0(15), The 工 .TE, for formulas (2) and (3) are 


251 (9) 5 - 
(4) y( 克 +1) PK+1 一 7 (ckTDR (L.IE. for the predictor)， 


19 
720 


Suppose that Ais small and y(G5)(D) is nearly constant over the interval; then the 
terms involving the fifth derivative in (4) and (S$) can be eliminated, and the result is 


(3) y(#+D 了 +1 一 yG)(Cd DDN5 (L.TBE. for the corrector). 


19 
(0) 7》( 大 上 +TD) +1 SS 70 (CN+1l PK+H) 
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New mesh 一 ~ 832 HL 2 丰 
一 ”一 一 和 一 一 和 一 一 一 “一 
Old mesh 一 -一 办 -3 太 _2 友 -_1 帮 


Figure 9.11 Reduction of the step size to 有 /2 in an adaptive method 


The importance of the predictor-corrector method should now be evident，For- 
mula (6) gives an approximate error estimate based on the two computed values Pk+1l 
and W+1 and does not use y(5) ( 门 . 


Practical Considerations 


The corrector (3) used the approximation 有 太 1 关 JPk+l in the calculation 
of +l. Since +lLis also an estimate for y( 姑 +D,it could be used in the corrector (3) 
to generate a new approximation for 有 太 +1，which in turn will generate a new value 
for 了 从 +1.， However, when this iteration on the corrector is continued, it will converge 
to afixed point of (3) rather than the differential equation. It is more eftficient to reduce 
the step Size 夺 more accuracy is needed. 

Formula (6) can be used to determine when to change the step size，Although 
elaborate methods are available, we Show how to reduce the step size to 严 /2 or increase 
itto 21. Let RelEr = 5 x 10 6be our relative error criterion, and let Small = 10 5. 


19 | 区 +1 PKk+H 严 
7 f -二 +rl Ri+L 、RelEmr then set 放 = 二 
(7) 270T 二 Small 2 
19 RelE 
(9) f .了 2 ytl Pt+tll -Re then set 大 二 2 





2701XrilSmal ”00 ， 


When the predicted and corrected values do not agree to five significant digits， 
then (7) reduces the step size. 玉 they agree to Seven or more Significant digits, then (8) 
increases the step Size，Fine-tuning of these parameters Should be made to suit your 
particular compnuter. 

Reducing the step size required fournew starting values. Interpolation of Fr y(D) 
with a fourth-degree polynomial is used to supply the missing values that bisect the in- 
tervals [大 2, 东 Iand [大 1, 灰 ] The four mesh points 灰 3/2, 灰 1 不 1/2, and 帮 used 
in the Successive calculations are shown in Figure 9.11. 

The interpolation formulas needed to obtain the new starting values for the step 
Size A/2 are 


5A 4+28F 3 70A +140A 1+35 庆 


As 
3A 4 20 扩 3+90 扩 ?十 60 六 1 5 大 
六 31/2 一 -~ 0 


JIncreasing the step Size is an easier task. Seven prior points are needed to double 


the step size. The four new points are obtained by omitting every second one, as shown 
in Figure 9.12. 
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太 _6 1K-4 办 2 太一 一 New mesh 
一 人 全 一 -一 和 一 人 一 
1k-6 办 -5 友 _4 友 -_3 办 -2 加 -1 丸 ~ 一 Old mesh 


Figure 9.12 ”Increasing the step size to 2P in an adaptive method. 


Milne-Simpson Method 


Another popular predictor-corrector scheme is known as the Milne-Simpson method. 
Its predictor is based on integration of (ty(D) over the interval [大 3, 灰 +1: 


耻 


(10) yerD = ye 引 二 1 ”ds yOD)dt 


了 攻 3 


The predictor uses the Lagrange polynomial approximation for F(, y(I)) based 


on the points (大 3 大 3 ( 2 大 20( 人 (站 关 and( 帮 大 ).Itis integrated over 
the interval [ 灰 3, 隶 +1]. This produces the Milne predictor: 


4 
(11) Pk+1l 一 其 3 十 可 己 灰 2 大 1 十 2 灰 ). 


The corrector is developed similarly，、The value 共 +1 can now be used，A sec- 
ond Lagrange polynomial for J(, y(D) is constructed, which is based on the points 


(让 1 产 D， (让 大 )，and the new point (不 + 太 +1) = (大 HL， (+ Pt+I)，The 
polynomial is integrated over [大 1, 灰 +1], and the result is the familiar Simpson's rule: 


瑚 
(12) +1 一 了 次 1 十 了 ( 太 1 十 4 大 二 大 +UD， 


Error Estimation and Correction 


The errorterms for the numerical integration formulas used to obtain both the predictor 
and corrector are of the order 0O(P5). The LTE. for the formulas in (11) and (12) are 


28 
(13) y(k+D Ph+l 一 页 光 Ce 大 (LTE. for the predicton， 
1 
(14) y(+1) HL 三 页 交 dtrD 生 (L.TE. for the correcton). 


Suppose that 庆 is small enough so that yG)(D) is nearly constant over the interval 
[ 放 3, 灰 +1]. Then the terms involving the fifth derivative can be eliminated in (13) and 
(14) and the result js 


28 
(15) 》( 姑 +1) Ph+1S ICUtl PK+1)， 


Formula (15) gives an error estimate for the predictor that is based on the two 
computed values pk+l and 兴 +1and does not use yG) (b. It can be used to improve the 
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predicted value， Under the assumption that the difference between the predicted and 
Corrected values at each step changes Slow1ly, we can Substitute pr and W for pk+land 


+Lin(1S) and get the following modifhier: 


(10) 1Uk+1 三 PKk+1 十 28 一 5 


This modified value is used in place of pr-+l in the correction step, and equation (12) 
becomes 


瑚 
(17) +l = 也 1 十 了 (大 1 十 4 关 十 (GTU mAK+H1I))， 


Therefore, the Improved (modifted) Milne-Simpson method is 


4 
Pk+1 三 居 3 十 本 (大 2 户 1+2A) (predicton 





JE 。 
一 28 difi 
(18) 12K 二 1 一 PK+L 十 59 (modifier) 
HI = 7(k+l KE+L1) 
天 
+1 一 以 工 十 了 ( 1 十 4 大 十 大 +D (corrector). 


Hamming's method is another important method, We shall omit its derivation, but 
furnish a program at the end of the section. As a final precaution we mention that al 
the predictor-corrector methods have stability problems. Stability is an advanced topic 
and the serious reader should research this subject. 


Example 9.13. Use the Adams-Bashforth-Moulton,Milne-Simpson, and Hamming meth- 
ods with 见 一 and compute approximations for the solution of the 1.V.P 


f 
y 一 一 y(0) = 1 over [0, 3]. 


ARunge-Kutta method was used to obtain the starting values 
71 三 0.94323919，“ 轧 = 0.89749071， and “ 轨 = 0.86208736. 


Then a compnuter implementation of Programs 9.6 through 9.8 produced the values in Ta- 
ble 9.12. The error for each entry in the table is given as a multiple of 10 8. In all entries 
there are at least Six digits of accuracy, In this example, the best answers were produced by 
Hamming's method. 四 
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Table 9.12 ”Comparison of the Adams-Bashforth-Moulton, Milne-Simpson, and Hamming 
Methods for Solving = (人  y)/2,y(0) = 1 











Adams- 
Bashforth- 
Moulton 






Milne- 
Simpson 


Hamming's 
method Error 























1.00000000 0E5 8 | 1.00000000 0 8 | 1.00000000 0E 8 
0.83640227 8E 8 | 0.83640231 4E 8 | 0.83640234 ] 尼 8 
0.81984673 16 已 8 | 0.81984087 2 8 | 0.81984688 1 瑟 8 
0.81186762 22 已 8 | 0.81186778 6E 8 | 0.81186783 1 瑟 8 
0.81194530 28 忆 8 | 0.81194555 3E 8 | 0.811945S8 0FE 8 
0.81959166 32 忆 8 | 0.81959190 8E 8 | 0.81959198 0E 8 
0.91709920 46 已 8 | 0.91709957 9 尼 8 | 0.91709967 1 五 8 
1.10363781 SIE 8 | 1.10363822 10E 8 | 1.10363834 25 8 
1.3S95$1387 52 已 8 | 1.3593S1429 10E 8 | 1.35951441 2 8 
1.43243853 S2 下 8 | 1.43243899 6 8 | 1.43243907 2 已 8 
1.S08$1827 S2 8 | 1.S08S1869 10OE 8 | 1.3$08$1881 2 8 
1.58756195 SIE 8 | 1.58756240 6E 8 | 1.38736248 2 8 
1.66938998 50 已 8 | 1.66939038 10E 8 | 1.66939050 2 已 8 





The Right Step 


Our selection of methods has a PurposeL first, their development is easy enough for a 
first course; Second, more advanced methods have a similar develjopment; third, most 
undergraduate problems can be solved by one of these methods.，However， when a 
Predictor-corrector method is used to solve the [LVP y = (ty)), where y(10) 一 y0， 
over a large interval, difficulties sometimes occur. 

开户 (yy) < 0andthe step size is too large, a predictor-corrector method might 
be unstable. As a rule of thumb, stability exists when a small error is propagated as a 
decreasing error, and instability exists when a small efror is Propagated as an increasing 
error, When too large a step size is used over a large interval, instability will result and 
is sometimes manifest by oscillations in the computed solution. They can be attenuated 
by changing to a smaller step size. Formulas (7) through (9) suggest how to Imodify 


the algorithm(s)，When step-size control js included, the following error estimate(S) 
should be used: 


隐 藉 


(19) y() 凑 冬 19 一 7570 (Adams-Bashforth-Moulton)， 
C20 yyGD 有 一 (Milne_ Simpson)， 
(29) 》y 人 (其 ) 总和 9 二 5 (Hamming). 


In all methods, the corrector step is a type of fxed-point iteration. It can be Proved 
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that the step size /for the methods must satisfy the following conditions: 


。 7 
(22) 严 儿 全 06067 (Adams-Bashforth-Moultom)， 
| 六 Gy| 
3.00000 
23 疡 儿 一 -一 (Milne-Simpsomn) 
人 万 p 
2.66667 
24 疡 < 儿 一 -一 一 一 (Hamming). 
2 万 加 2) 


The notation < in (22) through (24) means“much smallerthan”The nextexample 
shows that more stringent inequajities should be used: 


(29) 疡 一 5 (Adams-Bashforth-Moulton)， 
| 》 人 ， 了》 了 )| 
0.44 . 
20) 六 < 一 一 一 一 (Milne-Simpson)， 
历 吧 吕 
0.69 
27) < 一 -一 一 一 Hamming). 
护林。 Cammng) 


Inequality (27) is found in advanced books on numerical analysis，The other two in- 
equalities seem appropriate for the exampjle. 


Example 9.14， Use the Adams-Bashforth-Moulton, Milne-Simpson, and Hamming meth- 
ods and cormpute approximations for the solution of 


区 一 30 Sy， yy(0) 王 1 ， over the interval [0, 10]. 


Al three methods are of the order O(p4). When N = 120 Steps Was used for all three 
methods, the maximum error for each method occurred at a different place: 


y(0.416066667) 站 多 0.00277037 (Adams-Bashforth-Moulton)， 
y(0.33333333) 由 欠 -0.001392S5 (Milne-Simpson)， 
?y(0.33333333) 中空 0.00104982 (Hamming). 


At the right end points ! = 10, the error was 


y(10) yl120 兰 0.00000000 (Adams-Bashforth-Moulton)， 
y(10) 妨 20 鱼 0.00001015 (Milne-Simpson)， 
?>(10) 720 兰 0.00000000 (Hamming). 


Both the Adams-Bashforth-Moulton and Hamming methods gave approximate solutions 
with eight digits of accuracy at the right end point. 国 
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one>mn 了 


0 1 2 3 4535 6 7 8 9 10 


Figure 9.13 ”(a) The Adams-Bashforth-Moulton solution 
toy=30 5Sy with N =37steps produces oscilla- 
tion. It is stabilized when N = 6 because 严 一 10/65 = 
0.1538 0.15 = 0.73/5 = 0.75/| 户 (, y)|， 


to ma 中 说 


一 


0 12334567 8 959 10 


Figure 9.13 (人 b) The Milne-Simpson solution to y = 30 
Sy with N 一 93 steps produces oscillation. Lis stabilized 
when N = 110 because 严 = 10/110 = 0.0909 交 0.09 == 
0.45/5 = 0.45/| 甩 Gy)|. 


It is instructive to see that if the step size jls too large the computed solution os- 
cillates about the true solution，Figure 9.13 illustrates this phenomenon， The smal] 
number of steps was determined experimentally so that the oscillations was about the 
same magnitude. The large number of steps required to attenuate the oscillations were 
determined with equations (2S) through (27)， 

Each of the following three programs requires that the first four coordinates of T 
and Y be initial starting values obtained by another method，Consider Example 9.13， 
Where the step Size was 挛 一 and the interval was [0, 3]. The following string of 
commands in the MAILLAB command window win produce appropriate input vec- 
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fo mn 信人 让 


0 12234535 67 8 9 10 


Figure 9.13 〈c) Hamming's solution to 多 = 30 SS$y 
with N = 30 steps produces oscillation. It is stabilized 
when AN = 70 because 户 = 10/70 = 0.1428 0.138 = 
0.69/5 = 0.69/| 记 (7)|， 


tors Tand Y. 

>>T=zeros(1,25) |; 

>>Y=Zzeros(1,25) ; 

>>T=0:1/8:3; 

>>Y(1:4)=[1 0.94323919 0.89749071 0,.86208736] ; 





Program 9.6 (Adams-Bashforth-Moulton Method). To approximate the solution 
of the initial value problem y = jy) with y(a) = yo over [a, pb] by using the 
predictor 






天 
PK+1 三 站 十 人 9 大 3+37 斥 ? 59 庆 1 二 55 太 ) 





and the corrector 





严 
yk+1L 一 耿 十 芯 ( 太 2 5 庆 1+19 庆 十 9 








function A=abm(f,T,Y) 


/XInput - is the function entered as a string )f， 

为 -Tis the vector of abscissas 

久 -YY is the vector of ordqinates 

XRemark . The first four coordinates of T and Y must 

% have starting values obtained with RK4 

khOutput - A=[T， Y'] where T is the vector of abscissasg and 
儿 Y is the vector of ordinates 


Dn=1LIength(T) ; 


一 一 
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if nc5,break ,end; 

F=zeros (1 ,4) ; 

F=feval(f,T(1:4),Y(1:4)); 

bh=T(2)-T(1) ; 

for kk=4:D-1 
%Predictor 
P=Y(k)+(h/24)*(F*[-9 37 -59 55] ) ; 
T(Kk+1)=T(1)+h*k; 
F=[F(2) F(3) F(4) feval(f,T(k+t),p)]; 
YCorrector 
Y(k+1)=Y(K)+(h/24)*(Fk[1 -5 19 9] ) ; 
F(4)=feval(f,T(k+l),Y(k+1l1) ) ; 

end 

A=[T，Y?] ; 


Prosgram 9.7 (Milne-Simpson Methogd). TIo approximate the solution of the initial 
value problem y = ty) with y(a) = yo over [a,D] by using the predictor 


人 4 产 
Phk+1l 三 次 3 十 本 (大 2 太 1+2 太 ) 


and the corrector 


天 
+L = 其 1 十 了 (大 1 十 4 大 十 灰 +1). 








function M=milne(f,T,Y) 


%Input - fT is the function entered as a String : 节 )， 

共 -了 T is the Vector of abscissas 

人 -~ Y is the vector of ordinateg 

YRemark.， The first four coordinates of T and Y must 

办 have 8starting values obtained with RK4 

%Dutput - M=[T” Y'] where T is the vector of abscissas and 
六 Y is the Vector of ordinates 


n=1length(T) ; 

if Dn<5 ,break ,end ; 

F=zeros(1 ,4) ; 

F=feval(f,T(1:4),Y(1:4)) ; 

-.h=T(2)-T(1) ; 

Po1ld=0 ; 

yoJlLa=0 ; 

for X=4:Dn~1 
YPredictor 
pnew=Y(K-3)+(4*h/3)*(F(2:4)*[2 -1 2] :); 
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YNMNodifie7 
pmod=pnew+28*(yold-pold)V29 ; 
TCk+1)=T(1)+hx#k; 
F=[F(2) F(3) F(4) feval(f,T(k+l) ,pmod)] ; 
%Corrector 
Y(Ck+1)=Y(CK-1)+(h/3)*(F(2:4)*[1 4 1 ); 
Pold=pnew; 
yold=Y(k+1) ; 
F(4)=feval(f ,T(k+li) ,Y(Ck+1l)) ; 

end 


M=[LIT”Y] ; 





Program 9.8 (Hamming Method). To approximate the solution of the initial value 
Problem y = ,7) with y(a) = yo over [ea, 站] by using the predictor 








47 
Pk+L 一 其 3 十 本 已 灰 2 斥 1 十 2 太 ) 
and the coOrrector 


次 2 十 9 其 
8 


function H=hamming(t,T,Y) 


yK+1 一 





3 天 
十 训 ( 灰 1 二 2 大 十 HU， 


%IDput - f is the function entered as a String :f) 

多 -了 T is the vector of abscissas 

六 -YY is the vector of ordinates 

XkRemark . The first four coordinates of T and Y must 

从 have Starting valueg obtained with RK4 

XpDutput - H=IT， Y'] where T is the vector of abscissas and 
儿 Y is the vector of ordinates 


n=1ength(T) ; 

If Dn<5,break ,end ; 

F=zeros (1 ,4) ; 

F=feval(t,T(1:4) ,Y(1:4) ) ; 

h=T(2)-T(L) ; 

Poldq=0; 

Cold=0; 

for K=4:n-1 
YPredictor 
Pnew=Y(k-3)+(4+h/3)*(F(2:4)*[2 -1 2]，); 
YModifier 
Pmod=Pnew+1i12*(cold-polG)/121; 
T(k+1)=T(1)+hyk; 
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F=[F(2) F(3) F(4) feval(f,T(k+1) ,pmod)] ; 
Y%CorTector 
Cnew=(9*Y(K)-Y(k-2)+3*khk (FE(2:4)*#[-1 2 1]2))7V8; 
Y(k+1)=cnew+9*+r(Pnew-cnew)]V/Tt+21; 
Pold=pnew; 
Coldq=cnew; 
F(4)=feval(f,TCk+1) ,Y(k+1) ) ; 
end 
H=LT” Y?] ; 


Exercises for Predqdictor-Corrector Methods 


In Exercises 1 through 3， use the Adams-Bashforth-Moulton method, ,the three starting 
values 7y1，72, and y3, and the step Size 天 三 0.05 to calculate by hand the next two values 
y4 and ys for the LVP Compare your solution with the exact solution y(1). 


1 y 王 己 风 y(0)=1over[0,$,y 人 = e+b2 2 十 2 
y(0.05) = 0.951270S8 


y(0.10) = 0.905162538 
y(0.15) = 0.86179202 


2. 多 一 y 十 3 三,y(0) = 1over[0,5],y( 人 =2er+P 1 
y(0.05) = 1.05$0422 


y(0.10) = 1.1203418 
y(0.15) = 1.1961685 


3.yY= ty = Lover[l,14 ,> = (2 12)12 
y(1.05) = 0.94736477 


y(1.10) = 0.88881944 
y(1.1S) = 0.82310388 


In Exercises 4 through 6, use the Milne-Simpson method, the three starting values y1,，y2， 
and )3, and the step size 瑚 一 0.0S to calculate by hand the next two values WwW and y5 for 
the 工 VP Compare your solution with the exact solution y( 刀 . 


4.yY=e: yy0=1over[0,Sl,y( 人 = 一 te :+eLt 


y(0.03) = 0.99879090 
7(0.10) = 0.99332116 
?7(0.15) = 0.98981417 


5. 7 = 2172 y(0) = 1 over [0, 0.95],y( 人 =1 Do) 
y(0.05) = 1.0025063 


y(0.10) = 1.0101010 
?(0.15) = 1.0230179 
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6. y = 1 十 7?， y(0) = 1 over [0, 0.75], y() =tan( 十 元 /4) 
y(0.0S) = 1.10S35S56 
y(0.10) = 1.2230489 
y(0.1$) = 1.3$60879 


In Exercises 7 through 9, use the Hamming method, the three starting values y1，72, and 
y3, and the step Size 疡 = 0.09 to calculate by hand the next two values y4 and y5 for the 
LIV.P Compare your solution with the exact solution y(1). 


7. 多 一 2y 1?,y(0) = 1over[0,5], y() = 1+tanh(D) 
y(0.05) = 1.0499584 
y(0.10) = 1.0996680 
y(0.15) = 1.1488850 

8. 一 (1 7y2)V2. 7y(0) = 0 over [0, 1.55$], y() = sin(b) 
y(0.05) = 0.049979169 


y(0.10) = 0.099833417 
y(0.13) = 0.14943813 


冯 


多 一 六 sin(fh), y(0) = 1over[0, 1.55]， y( 一 Sec(b) 


y(0.05) = 1.0012513 
y(0.10) = 1.0050209 
y(0.15) = 1.0113564 


Algorithms and Programs 


1.(a) 
(b) 
2. (3) 
(D) 
3.， (9) 
(b) 


Use Program 9.6 to solve the differential equations in Exercises 1 through 3. 
Plot your approximation and the exact solution on the Same coordinate System， 
Use Program 9.7 to solve the differential equations in Exercises 4 through 6. 
Plot your approximation and the exact solution on the same coordinate system. 
Use Program 9.8 to solve the differential equations in Exercises 7 through 9. 
Plot your approximation and the exact solution on the same coordinate system. 


4. Produce a graph analogous to Figure 9.13 by using Program 9.6 with N = 37 and 


AN = 


6065 to solve the IVP. 


=30 S$y， y(0) =1 over[0, 10]. 


S. FortheI.VP yy =45 9y,y( = 0over [1, 20]: 


(9) 
(b) 


Use inequality (22) to determine for which step sizes the Adams-Bashforth- 
Moulton method might be unstable. 

Based on your Iesults from part (a) select step sizes jy and PP， for which the 
Adams-Bashforth-Moulton method should be stable and unstable, respectively. 
Use a Runge-Kutta method to generate three starting values y1，y2, and y3 for 
each of the step sizes, 
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(c) Use Program 9.0 to generate two approximations, one for each Step Size, to the 
LVP 


( 帅 Use your Tesults from part (c) to produce a graph anaiogous to Figure 9.13. You 
Imay find it necessary to experiment with several sets of step sizes. 


Systems of Diffterential Equations 


This section is an introduction to Systems of differential equations，To illustrate the 
concepts, we consider the initial value problem 


(D 


GX 
万 = Gy 本 X(t) 三 xz0， 
y(1) = ?0. 


y 
一 ”一 7， 
克 SC xy) 


Asolutionto (lJ)i8apairof differentiable functions x(ti) and y(f with the property 
that when tx(0, andy(0 are substituted in 矿 t, xy) andg(t, xz, y),theresultis equal 
to the derivative xz (0) and (0, respectively; that is 


四 xD = xz， y(CD) | [2 


y (一 8 y(GD) y(o) = y0. 


For example, consider the System of differential equations 
(3) 


The solution to the 1I.V.P (3) is 


X( 引 一 4e4 十 2e 上 


4 
人 y( 人 =6e4 2e 上 


This is verified by directly substituting x (1) and y(0 into the right-hand side of (3)， 
computing the derivatives of (4), and substituting them in the left side of (3) to get 


16e4 2e := (4ek 十 2e 中 十 2(6e4 2e 虽 ， 
24e4: 十 2e ! 一 3(4e4 十 2e 间 十 2(6e4 2e 间 ， 
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Numerical Solutions 


A numerical solution to (1) over the interval gd 二 ! < D is found by considering the 
differentials 


(9) dz 一 lx yd and dy=80xry)dL. 


Eujlers method for solving the system is easy to formulate. The differentials dz 王 
灰 +1 太一 人 区 + 了 ,anddy 王 次 + 其 aresubstituted into (S) to get 


ML 其 写 (大 大 ,了 KJ)( 帮 1 太 )， 


(0) 
了 其 +1 其 全 8 大 ,了 其 )(HL 大 ). 

The interval is divided into AM subintervals of width 于 = ( aa)/M, and the mesh 

points are 隶 +1 一 灰 十 产 . This is used in (6) to get the recursive formulas for Euler's 

method: 


灰 +1 一 灰 十 彤 ， 
(7) XK+L 一 区 十 瑚 站 了 ，， 交 )， 
其 f1 三 从 十 jg 人 kx for 大 ==0 1 ...，M 1， 


Ahigher-order method should be used to achieve a reasonable amount of accuracy. 
For example, the Runge-Rutta formulas of order 4 are 


天 
XkA+1L 一 大 十 二 ( 户 十 2 户 十 2 户 十 及)， 


G) 6 
+1 一 关 十 (81 十 282 十 283 十 84)， 
where 
万 = JU 砍 ，y)， 81 一 8( 丰 ,XU 区 )， 
户 = 7 (w+ 外 天 二 和 次 二 9， 一 8 人 (+ 和 六 二 w+， 


= 了 [大 十 二 , 砍 十 二 户 ,其 十 一 8 大 十 二 ,了 砍 十 二 户 , 关 十 二 
， ? ? 》 ， ， 
有 亡 大 2 大 7 2， 基 282 83 81 大 大 了 2，J) 状 82 


及 三 了 (不 十 帮 克 十 天 户 , 次 十 P83)， 8S4 一 8( 庆 十 疡 不 十 天 户 , 次 十 放 83) . 


Example 9.1S， Use the Runge-Kutta method given in (8) and compnute the numerical 
solution to (3) over the interval [0.0, 0.2] using ten subintervals and the step size 玉 = 0.02， 
For the first point we have 归 = 0.02 and the intermediate calculations required to 
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Table 9.13 “Runge-Kutta Solution tox“() 王莽 十 27，y7 (一 3x 十 27 
with the Initial Values x(0) = 6 and y(0) = 4 















xx 









0 4.00000000 
1 4.53932490 
2 6.61562213 .11948599 
3 6.96852S28 5.74396525 
4 7.35474319 06.41653305 
5 7.77697287 7.14127221 
6 8.23813750 7.92260406 
7 8.74140523 8.76531667 
8 9.29020955 9.67459538 
9 9.88827138 10.6560560 
10 10.5396230 11.715S7807 





compute xl and 攻 are 


户 = 0.00,6.0,40) = 14.0 81 = 8(0.00, 6.0,4.0) = 26.0 
x0 十 2 = 6.14 yo 十 28l 一 4.26 

户 = 1(0.01, 6.14,4.26) = 14.66 8 = 8(0.01, 6.14, 4.26) = 26.94 
X0 十 2 户 = 6.1466 yo 十 82 一 4.2694 


户 = 了 0.01,6.1466, 4.2694) = 14.6854 

83 = (0.01, 6.1466, 4.2694) = 26.9786 
X0 十 瑚 户 = 6.293708 yo 十 凡 83 一 4.339572 
户 = (0.02. 6.293708, 4.539572) 王 15.37285S2 
84 三 (0.02, 6.293708, 4.539572) = 27.960268 


These values are used in the final computation: 


0.02 
X1 一 6 十 - 世 440 十 2(14.66) 十 2(14.6854) 十 15.372852) = 6.29354551， 


一 4 十 6.0 十 2(26.94) 十 2(26.9786) 十 27.960268) = 4.53932490， 


The calculations are summarized in Table 9.13. 
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The numerical solutions contain a _ certain amount of error at each step，For the 
example above, the error grows, and at the right end boint 上 = 0.2 it reaches its maxi- 
Imum: 


X(0.2) xl0 = 10.$396232 ”10.3396230 = 0.0000022， 
y(0.2) Jo = 11.7137841 11.7157807 = 0.0000034. 


Higher-order Differential Equations 


Higher-order differential equations involve the higher derivatives x (1 xD)， and so 
on,. They arise in mathematical models for problems in physics and engineering. For 
example， 


1X2(t 十 cx 人 十 1 人 (一 8 人 


represents a mechanical System in which a spring with Spring constant K restores 8 
displaced mass 六 ，Damping is assumed to be proportional to the velocity, and the 
function g(0) is an external force. It is often the case that the position x(1o) and velocity 
X'(10) are known at a _ certain time 加 0. 

By solving for the second derivative，we can Write a Second-order initial value 
problem in the form 


(9) 太 人 =FUxrD xD) with x(o) =xo and x (io) = 20. 


The second-order differential equation can be reformujlated as a System of two first- 
order equations 让 we use the substitution 


(IC7 CD 一 yCID) 


Then x“() = y (人 and the differential equation in (9) becomes a System 


with (如 ) 一 X0， 


(GD) 
dy y(1o) 三 y0.， 


A numerical procedure such as the Runge-Kutta method can be used to solve (11) 


and will generate two Sequences fk and {}]，The first sequence is the numerical 
sojluation to (9 The next examnle can he interpreted as damped harmonic motion. 


SEC. 9.7 ”SYSTEMS OF DIFFERENTIAL EQUATIONS 491 


Table 9.14” Runge-Kutta Solution to x 7“() 十 4x() 十 Sx() 一 0 with 


the Initial Conditions x(0) 一 3andx'(O) = 5 





















大 
0 3.00000000 3.00000000 
1 . 2.$2564583 2.525065822 
2 0.2 2.10402783 2.10404686 
3 0.3 1.73306269 1.73308427 
4 0.4 1.41653369 1.41655509 
5 0.5 1.14488509 1.14490455 
10 1.0 0.33324302 0.33324661 
20 2.0 0.00620684 0.00621162 
30 3.0 0.00701079 0.00701204 
40 4.0 0.00091163 0.00091170 
48 4.8 0.00004972 0.00004969 
49 4.9 0.00002348 0.00002345 
0.00000493 0.00000490 








Example 9.16， Consider the second-order initial value problem 
XI 十 4xz (人 十 Sx(0 王 0 with x(0) = 一 3 and xz(O0 = 9. 


(a) Write down the equivalent System of two first-order equations， 


(b) Use the Runge-Kutta method to solve the reformujlated Problem over [0, S] using 
AM = S0 subintervals of width 疡 一 0.1. 


(c) Compare the numerical solution with the true solution': 
x 人 (一 3e 2cosG) 十 e 2sin(b). 
The differential equation has the form 
X (0 一 tx xD)) 一 4r 人 0)  Sxz(0). 


Using the substitution in (10), we get the reformulated problem: 


dx 

和 ith [各 2 
全 - ?0) = >， 
克 Sx 47y 


Samples of the numerical computations are given in Table 9.14. The values {)k] are ex- 
traneous and are not jncluded，Instead, the true solution values {x(A)}) are included for 
comparison， 恒 
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卫 xercises for Systems of Differential Equations 





In Exercises 1 through 4, use 瑚 = 0.03 and 


(a) Euler's method (7) by hand to find (xl, y1) and (xz,，y2). 
(b) the Runge-Kutta method (8) by hand to find (xl, y1). 


1. Solve the Systemx' = 2x 十 3y, y = 2x 十 y with the initial conditionx(0) = 2.7and 
y(0) = 2.8 over the jinterval 0 <1 < 1.0 using the step size 疡 = 0.0$. The polygonal 
Path formed by the solution set is given in Figure 9.14 and can be compared with the 
analytic Solution; 
69 3 69 1 
站 二 一 ee 5 二 e4 d 四 一 一 ee 一 e4 
xz 一 55 二 54 and 7 二 交 * 十 巧 

Solve the systemx' 三 3x 六 多 =47 ywiththe initial conditionx(0) = 0.2 and 
y(0) = 0.3 over the interval 0 < 上 < 2 using the step Size 户 = 0.05. The polygonal 
path formed by the solution set is given in Figure 9.1S and can be compared with the 
analytic solution: 


2 


1 1 1 
X(1) 一 52 攻 经 and  y(f) 一 本 2 Se 
3. Solve the systemx' = 4y,y =x 十 》with the initial condition x(0) = 2 and 
y(0) = 3 over the interval 0 二 上 < 2using the step Size = 0.05. The polygonal 
path formed by the solution set is given in Figure 9.16 and can be compared with the 
analytic Solution: 


xD 一 2e( 十 4etcos2(f) 12etcos(f) sin(f) 


and 
y(0) = 3e! 十 6etcos2() + 2etcos(f sin(t). 
了 了 了 
3 
0.8 
了 0.6 
0.4 
] 
0.2 
才 万 
-2 -1 0 1 2 0.0 0.1 0.2 
Figure 9.14 “The solution to the sys- Figure 9.15 The solution to the Sys- 
temx' 一 2x 十 3yandy 一 2xz 十 yover temx' 一 3x yandy 一 4x yover 


[0.0, 1.0], [0.0, 2.0]. 
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4. Solve the systemx = yy 4x,y =x 十 》with the initial condition x(0) = 1 and 
y(0) = 1over the interval 0 < ! < 1.2 using the step size 疡 = 0.03. The polygonal 
path formed by the solution set is given in Figure 9.17 and can be compared with the 
analytic solution: 


3e V258112 3evV 卫 "2 e V2912 十 eV 宛 02 


的 
and 
四 7e V2512 + TeV25r2 e V2512 十 ev29r12 
y (三 一 一 一 一 


2、/79e3L/2 2e31/2 


In Exercises S through 8: 


(al) Verify that the function x(D) is the solution. 


(b) Reformulate the second-order differential equation as a system of two first-order 
equations. 


(c) Use 严 一 0.1 and Euler's method by hand to find xl and x2. 
(d) Use 玉 一 0.0S and the Runge-Kutta method by hand to find x1. 
S. 2x7() SSx'( 3xz() = 45e2 with x(0) ==2andx'(0) 一 1 
X( 人 一 4e 02 十 7e3 9e2 
6. zx) 十 6xz (0) 十 9xG) 一 0withxz(0) 一 4andx' 0) = 4 
x( 人 (一 4e 3 十 8ie 3 
7. x“ (十 xD 一 6cos() with x(0) =2andx'0) 三 3 
x( 人 (tf 一 2cos( 和 十 3sin(i) 十 3fSin(b 
8. x+3xG) 三 12withx(0) =Sandx'(0) = 1 
XI 一 4 十 4f 十 e 3 


了 》 
5 
一 
六 
10 20 3 
2 
工 
交 
-20 00 02 04 06 08 1 
Figure 9.16 Tbe solution to the sys- Figure 9.17 The solution to the sys- 
temx' 一 X 4yandy 一 寺 十 yover temx' 一 》 4xrandy 一 x 十 yover 


[0.0, 2.0]. [0.0, 1.2]. 
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Algorithms and Programs 





1，Write a program to solve a System of equations by the Runge -Kutta method of order 
六 =4(8). 


In Problems 2 through $, use your computer Implementation of the Runge-Kutta method 
for Systems to solve each System using the step size 刀 = 0.03.， Plot your approximation 
and the analytic solution on the same coordinate System. 
2. xf 一 27 卡 3y， 多 二 2 十 y, with x(0) = 2.7， y(0) = 2.8 over0 < 上 <1.0 
X 人 (三 六 c “十 疝 @4 and y() 一 各 e ! 十 二 64 
3.xX 一 3x 岂 多 =4r ywWithx(O) =0.2,y(0) 三 0.3Sover0<1<2 
X(D 一 了 e: 下 ie: and y(1) 一 Je re 
4.2=x 4 =x+y withx(0) =2,y(0)=3over0<r<2 
X( 人 一 2er 十 4ercosz(f) 12ercos( sin(D) 
y( 人 = 3e' 十 6etcos2(f) 十 2elcos(D sin(D 
S. 7 = 一》 4r 交 =x++》 withx(0) =1,y(0) =1lover0<1<12 
3e V2902 3ev3512 ee。 V29r12 十 ev251/2 


xl) 一 2 天 本 7 有 本 万 
Te V29012 十 TeV25772 Ce V55112 十 eV2902 
2 
In Problems 6 through 9: 


(a) Reformulate the second-order differential equation as a System of two first-order 
equations. 


(b) Use your compnuter implementation of the Runge-Kutta method for systems to solve 
each System over the interval [0, 2] with the Step size 忆 = 0.05. 


(c) Plot your approximation and the analytic solution on the same coordinate system， 


6.2x7( 人 1)  Sxz( 人 3xr(0 三 45e2r with xf(0) 一 2andx'(0) = 1 
X( 人 一 4e 1 十 7e3 9e2 


7.x(O 十 6x( 人 十 9x() 一 0withx(0O) 一 4andx 0) = 4 
2 人 一 4e 3 十 8re 于 


8. xD) 上 +xO0 王 6cos( Withx(0) =2andx(0) 三 3 
X 人 一 2cos(f) 十 3sin(t) 十 3fsin(t) 

9. xz) 十 3x 人 0) = 12 with x(0) 一 Sandx'(0) = 1 
X( 人 一 4 十 4 十 e 于 


In Problems 10 through 19, use your compnuter implementation of the Runge-Kutta method 
of order N = 4to solve the given differential equation or System of equations. Plot each 
approximation . 


10，A certain Tesonant Spring System with a periodic forcing function is modeled by 


X (十 2Sx(0) 三 8sin(S0) with x(0O) =0 and x (0) = 0. 


SEc. 


11. 


12 


13. 


14， 


1S， 


16. 
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Use the Runge-Kutta method to solve the differential equation over the interval [0, 2] 
using hf = 40 steps and 疡 = 0.05. 


The mathematical model of a_ certain RLC electrical circuit is 
2C" (十 200 上 (0 十 1250(0 = 9sin(5D 


with C(0) = 0 and CO“(0) = 0. Use the Runge-Kutta method to solve the differential 
equation Over the interval [0, 2] using AMf = 40 steps and 挛 = 0.05. Remark. 7(1) 一 
CD is the current at time 上 


Attime #apendulum makes an anglex() with the vertical axis, Assuming that there 
is no friction, the equation of motion is 


MIlx' (tf) 一 718gsin(xz 人 有)， 


where mm is the mass and ! is the length of the string. Use the Runge-Kutta method 
to solve the differential equation over the interval [0, 2] using M = 40 steps and 
及 一 0.05Sifg = 32ftsecz and 

(a) /=3.2ftandx(0) =0.3andx'(0) = 0. 

(D) 7 =0.8ftandx(0) =0.3andx'(0) = 0. 


Predatorprey model， An example of a system of nonlinear differentiat equations 
is the predatorprey problem. Let x (0) and 7(f) denote the population of rabbits and 
foxes, respectively, at time !。 The predator-prey model asserts that xz(f) and 7(I 
satisfy 


xD 一 4x()  Bx()y(D， 
y (D = Cx()y(D  Dy(0)， 


Atypical computer simulation might use the coefficients 
4=2， 有 =002， C=0.0002， =0.8. 


Use the Runge-Kutta method to solve the system of differential equations over the 
interval [0, S] using M = S0 steps and 严 一 0.2 让 
(a) xx(0) = 3000 rabbits and y(0) = 120 foxes， 
(p) ， x(0) = S$000 rabbits and y(0) = 100 foxes， 


Solvyexy =7 xy 多 = 了 二 xy Withx(0) = 一 4andy(0) = 1over[0,8] using 
六 一 0.1，The trajectories of this system form closed paths，The polygonal path 
formed by the solution set is one of the curves shown in Figure 9.18. 


Solvex = 3x 27 2xy2 多 =2xz yy+2y3 withx(0) = 0.8 and y(0) = 0.6 
over [0, 4] using 六 = 0.1. For this system, the origin is classified as a spiral point that 
is asymptotically stable. The polygonal path formed by the solution set is one of the 
curves shown in Figure 9.19. 


Solvyex = 只 克 = 2xy withx(0) = 2.0andy(0) = 0.1 over [0.0, 1.5] 
using 玉 = 0.0$. For this system, there is an unstable saddie point at the origin. The 
polygonal path formed by the solution set is one of the curves shown in Figure 9.20. 
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了 
1.0 
0.0 
(人 妆 。 
0 1 2 3 4 -0.2 02 04 06 08 
Figure 9.18 Solutions to the systerIn Figure 9.19 Solutions to the System 
x' 一 X xyandy 多 一 了 十 xy Xi 一 3xY 2 2ry2andy 一 2x 
了 十 273. 
》 了 3 
2 
2.0 
1.6 
1.2 
0.8 
0.4 
六 攻 
0.0 0.5 1.0 1.5 2.0 -2 -1 1 2 
Figure 9.20 Solutions to the system Figure 9.21 Solutions to the system 
xf/ 一刀 x2andy 一 2xy. xf 一 1 yand 多 一 xz2 7. 


17. Solvex =1 yyY=x22 并 withx(0) = 12andy(0) = 0.0over10,S$] using 
疡 一 0.1. The point (1, 1) is a spiral point that is asymptotically stable, and the point 
( 1, 1)is an unstable saddle point, The polygonal path formed by the solution set is 
one of the curves shown in Figure 9.21. 


18. Solvex' = xx 2xy2, 7 = 2x2y7 7 with x(0) = 1.0 and y(0) = 0.2 over 
[0, 2] using 记 三 0.025$. This system has an unstable critical point at the erigin. The 
polygonal path formed by the solution set is one of the curves Shown in Figure 9.22. 

19. Solvyex' 一 xz 妇 , 允 =2xzy withx(0) = 2.0andy(0) = 0.6 over [0.0, 1.6] using 
户 = 0.02. The origin is an unstable critical point. The polygonal path formed by the 
solution set is one of the curves shown in Figure 9.23. 
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? 》 

2.0 

1.5 

1.0 

0.5 AT 

光 疙 

0.0 0.5 1.0 1.5 2.0 -3 -2 -1 0 1 2 3 
Figure 9.22 Solutions to the System Figure 9.23 Solutions to the system 
X 一 X3 2xy2andy 一 2r2y 妇 . Xi 一 tandy 一 2xry. 


Boundary Value Problems 

Another type of differential equation has the form 

(]) 米 一 Flxxz) for ca<t<b， 
with the boundary conditions 

(2) x(a)=a and xb)= 有 . 


This is called a bordery value Propiemz. 

The conditions that guarantee that a solution to (]) exists should be checked be- 
fore any numerical scheme is applied; otherwise, a list of meaningless output may be 
generated. The general conditions are stated in the following theorem. 


Theorem 9.8 (Boundary Value Probliem)， Assume that 三 (, x, y) ls continuous on 
the region 尺 = { 人 xy) :4a<I<pD oo <7<oco co < < oolandthat 
3f/axr = 户 (人 xy)andaf/ay = 户 (x,y) are continuous on RI there exists a 
constant M > 0 for which 户 and 户 satisfy 


(3) Ptxy)>0 for al (tx,y)eR and 
(4) | 亡 (x， y7)| < AM for al (xy)E 玉 ， 


then the boundary value problem 
(9) 刀 一 txz) with x( 一 a andxz() = 有 


has aunique solution x 一 xfora 1< 六 . 
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The notation 》 一 x“(f) has been used to distinguish the third variable of the func- 
tion bz, )，Finally, the special case of linear differential equations is worthy of 
mention， 


Corollary 9.1 (Linear Boundary Value Problem). Assume that 六 in Theorem 9.8 
has the form ex,y) = py7+9(Oxz 十 r() andthat 矿 and its partial derivatives 
0j//ax =q()andap/ay = P(D are continuous on R. Ifthere exjsts aconstant M > 0 
for which P(t) and g(b satisfy 


(0) da(I>0 foralre[c,p，and 
(7) |P(ODI < M = ax 人 Po 有， 


then the jzear porradary Palue propierm 
(8) xz 一 PC)x (DTTq(OrOD 二 rr with x(a) 一 oa and x(D) 一 有 


has a unique solution x 一 x(f) overaQ <T <D. 


Reduction to Two IVP'S: Linear Shooting Method 


Finding the solution of a linear boundary problem is assisted by the linear structure of 
the equation and the use of two special initial value problems. Suppose that x(f) is the 
unique solution to the [VP 


(9) 巡 一 POCODACD 二 gx 二 rt) with xc) =a and w(a) = 0. 
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Furthermore, Suppose that uv(i) is the unique solution to the 工 VP 

(10) 几 =PDu(D +dqCu with va) =0 and uv(a) = 1 

Then the linear combination 

(1 xf) 一 VU) 十 CUV 

is asolution to x” = PCDx' (DJ 二 9(ODxG) 十 r(bD as seenbythe computation 


太一 必 十 C 咪 =POOD 二 (OUGD 二 rr 十 PCuG) 十 gGDCu(D) 
= POCOD 二 CuY(GD))+gODOCCGD 二 CuGD)) 十 r(0) 
= PCDxz (十 4(Dxz() 十 r(D)， 


The solution x(D in equation (11) takes on the boundary values 


(2) X(G) 一 Ma) 十 Cu(a) =aw 二 0=aw， 

2X(D) 一 xD) 十 CU(D). 
Imposing the boundary condition x(b) = 8 in (12) produces C == (6 xD))/u(D)， 
Therefore, if v(p) 夭 0, the unique solution to (8) is 


px 
(13) xf) 一 2(t) 十 DY) 


Remark. 开 4 fulfills the hypotheses of Corollary 9.1, this rules out the troublesome 


solution v(b) 三 0, so that (13) is the form of the Tequired solution, The details are left 
for the reader to investigate in the exercises. 


Example 9.17. Solve the boundary value problem 


271 2 
2 (1 一 TTx OO T 二 52x(0) 十 1 
with xz(0) = 1.25 and x(4) 一 0.95 over the interval [0, 4]. 

The functions P，9，and r are PO) 一 21/(1 十 2)， qd = 2/(1 二 71，and 
r(b = 1，respectively，The Runge-Kutta method of order 4 with Step Size 六 一 0.2 
is used to construct numerical solutions {& jj] and {ujj to equations (9) and (10), respec- 
tively. The approximations {zx 门 for xi are given in the first column of Table 9.15. Then 
L(4) Srk20 一 2.893535 and v(4) S% v20 = 4 are used with (13) to construct 


5 xd 
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Table 9.1S ”The Approximate Solutions {z< 站 = { 十 由 站 to 
21 
the Equation x”() 一 XI) 十 1 





1 十 纪 


1 十 刀 2 





























































. 1.2$0000 0.000000 1.250000 
0.2 1.220131 0.097177 1.317308 
0.4 1.132073 0.194353 1.326426 
0.6 0.990122 0.291530 1.281652 
0.8 0.800569 0.388707 1.189276 
1.0 0.370844 0.485884 1.056728 
1.2 0.308850 0.583061 0.891911 
1.4 0.022522 0.680237 0.702759 
1.6 0.280424 0.777413 0.496989 
1.8 0.5920609 0.874591 0.281982 
2.0 0.907039 0.971767 0.064728 
2.2 1.217121 1.068944 0.148177 
2.4 1.516039 1.160121 0.350518 
2.6 1.799740 1.263297 0.536443 
2.8 2.060904 1.360474 0.700430 
3.0 2.294916 1.457651 0.837265 
3.2 2.496842 1.334828 0.942014 
3.4 2.662004 1.652004 1.010000 
3.6 2.785960 1.749181 1.036779 
3.8 2.864481 1.846358 1.018123 

2.893535 1.943535S 0.950000 





Then the required approximate solution is {xj 站 三 {o 十 由 ， Sample computations are 
givenin Table 9.19, and Figure 9.24 Shows their graphs. The reader can verify thatv(i) 一 ! 
is the analytic solution for boundary value problem (10); that is， 





2 
U(1) 王 VD) 二 束 2O) 


1 十 弓 
with the initial conditions v(0) = 0 and (0) = 1. 

The approximations in Table 9.16 compare numerical solutions obtained with the linear 
shooting method with the step sizes 挛 = 0.2 and 户 一 0.1 and the analytic solution 


1 1 
xi) 一 1.25 十 0.4860896526! ”2.2512 十 2f arctan(D) 了 In(1 二 12) 十 5 ln(l 十 刀 )， 


A graph of the approximate solution when 疡 一 0.2 is given in Figure 9.23. Included 记 
the table are columns for the error Since the Runge-Kutta solutions have error of order 
O(p4), the error in the solution with the smaller step Size 忆 一 0.1 is about 站 the error of 
the solution with the large step Size 太一 0.2. 本 


Program 9.10 will call Progrant 9.9 to solve the initial value problems (9) and (10). 
Program 9.9 approximates solutions of systems of differential equations using a mod- 
过 cation of the Runge-Kutta method of order 六 = 4 Thus, it is necessary to Save 
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= mw 人 


一 李 


Figure 9.24 Numerical approxinaations 4(1) and (fr) used to 
form x() 一 Ai) 十 岂 (O which is the solution to 
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< 人 0 T 二 5 


“(D) 





2 
1 十 


1 





(1 十 





之 
































Table 9.16 “Numerical Approximations for x“(D) 一 1 了 订 xD) 十 1 
一 下 一 
大 )/ X(D7) X() x 并 xD 门 xD 门 A 
万 玉 王 0.2 exact errOT 记 7 瑚 一 0.1 exact errOT 
加 四 J | 一 一 一 一 一 一 一 一 
0.0 1.2S0000 1.230000 | 0.000000 0.0 1.2S0000 1.250000 | 0.000000 
0.1 1.291116 1.291117 | 0.000001 
0.2 1.317308 1.31735S0 | 0.000042 0.2 1.317348 1.3173S0 | 0.000002 
0.3 1.328986 1.328990 | 0.000004 
0.4 1.326426 1.326S0S | 0.000079 0.4 1.326500 1.326505 | 0.000005 
0.5 1.310S08 1.310$14 | 0.000006 
0.6 1.281652 1.281762 | 0.000110 0.6 1.281756 1.281762 | 0.000006 
0.8 1.189276 1.189412 | 0.000136 0.8 1.189404 1.189412 | 0.000008 
1.0 1.056728 1.056886 | 0.000158 1.0 1.0S6876 1.0$6886 | 0.000010 
1.2 0.891911 0.892086 | 0.000175 1.2 0.892076 0.892086 | 0.000010 
1.6 0.496989 0.497187 | 0.000198 1.6 0.497175 0.497187 | 0.000012 
2.0 0.064728 0.064931 | 0.000203 2.0 0.064919 0.064931 | 0.000012 
2.4 0.350518 0.350325 | 0.000193 2.4 0.3S0337 0.350325 | 0.000012 
2.8 0.700430 0.700262 | 0.000168 2.8 0.700273 0.700262 | 0.000011 
3.2 0.942014 0.941888 | 0.000126 3.2 0.941895 0.941888 | 0.000007 
3.6 1.036779 1.036708 | 0.000071 3.6 1.036713 1.036708 | 0.000005 
4.0 0.9S0000 0.950000 | 0.000000 4.0 | 0.9S0000 0.950000 | 0.000000 





the equations (9) and (10) in the form of the system of equations (11) of Section 9.7. 
As an ilustration, consider the boundary value problem in Example 9.17. The follow- 


S02 CHAP.9 SoLUTION OF DIFFERENTIAL EQUATIONS 





Figure 9.2S ，TIhe graph of the numerical approximation for 


241 2 
X(C1) 一 TO) IT5xO) 十 1 


(using 刀 一 0.2). 


ing M-file, named F1， will save the LI.V.P (9) in the form of a system of differential 
equations. 

function Z=Fl(t,Z) 

X=Z(1);y=Z(2) ; 

Z= [y,2x#tx#y/(1+t -2)-2*x/(C1+t>2)+1] ; 


Asimilar M-file, named F2, will savetheIVP (10) (just letr( 站 =0inFl)inthe 


appropriate form. 
A plot of the approximation obtained from Program 9.10 can be constructed by 


using the command plot(L(: ,1)，L(C:,2))， 





Program 9.9 (Runge-Kutta Method of Order N = 4 for Systems)，To approxi- 
mate the solution ofthe system of differential equations 






X1( 人 一 万 (xD xn 人 (D) 






2 人 (一 户 ( 人 xx 人 D) 





with xl(a) = al .Mr(a) = an overthe interval [a, 中 ]. 








function [T,Z]=rks4(F,a,b,Za,M) 


%Input -了 is the system input as a StTing ?FF)， 

人 -~ aandb are the end Points of the interval 
入 - Za=[x(a) y(a)] are the initial conditions 
六 - M is the number of steps 
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MOutput - T is the Vector of steps 


人 - Z=[xl(t)...xn(t)]; where xk(t) is the approximation 
包 to the kth dependent variable 
h=(b-a)V/M; 


T=zeros(1 ,M+1) ; 

Z=zeros(M+1, Length(Za) ) ; 

T=a:h:b; 

Z(1,:)=2Zai 

for j=1:M 
Kil=h#*feval(F,T(j),Z(j,:)); 
k2=h*feval(F,T(j)+h/2,Z(j,:)+k1/2) ; 
X3=h*feval(P,T(j)+hV/2,Z(j,:)+k2/2) ; 
k4=h*+feval(P,T(j)+h,Z(j, :)+K3) ; 
Z(j+1，,:)=Z(j,:)+(kt+2+Kk2+2#k3+K4)V6; 


end 











Program 9.10 (Linear Shooting Method). To approximate the solution of the 
boundary value problem x”″”= PCDx') + gxzG) 十 r() with x(a) = aw and 
xD)= 三 poverthe interval [a,5] by using the Runge-Kutta method of order N = 4. 






function L=1insht(F1,F2,a,b,alpha,beta,M) 


%Input -~- Fl1 and F2 are the Systems of first-order equations 

名 representing the I.V.P.s (9) and (10) ，respectively; 
从 input as strings )F1:，?F2)， 

% -~- a and b are the end points of the interval 

包 -~ alpha = X(a) and beta = x(b); boundary conditions 

入 - M is the number of steps 

VDOutput - 工 =[T' 刀 ; where T' is the (M+1)xt vector of 

% abscissas and X is the (M+1)xl vector of ordinates 


XSolve the System F1 

Za= [alpha,0O] ; 
[IT,Z]=zrks4(Ft,a,b,Za,M) ; 
U=Z(0: 1) ; 

%MSolve the system F2 
Za=[0,1] ; 

[T ,Z]=rks4(F2,a,b,Za,M) ; 
V=Z(: ,1) 3; 

%Calculate the solution to the boundary value Prob1lem 
X=U+ (beta-U(M+1) )*V/VV(CM+1) ; 
L=[T，X] ; 
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卫 xercises for Boundary Value Problems 





1，Verify that the 名 onction x(D) is the solution to the boundary value Problem. 
(a) z 刀 =( 2/bDx 上 +(2/0)xr 十 (10cos(ln(D))]A2 over [1,3] with x(D = 1and 
x(3) 一 1. 


四 4.335950689 ”0.335950690873 312 cos(ln(D)) 十 2 sin(in(D) 
X 人 人 三 一 -一 ~ 一 一 
本 


(bp xz 一 2r 2r+e 5 +sin(2r)over[0,4] with x(0) = 0.6andx(4) 一 0.1. 
1 ”1 2 
xf) 一 5 十 e 上 了 :cos(I) 5 cos2 人 (站 
1 
十 3.670227413e :sin(1) 5 cos(f) Sin(t) 


(cj) x = 4r′ 4x 十 5cos(4f) 十 sin(21) over [0, 2] with x(0) = 0.75$ and x(2) = 
0.25. 


1 19 
X (1 一 而 十 1L025e 2 1.91572997Sre “十 而 cos 0) 


Ceos 人 8 os si 
5 COS (四 5 cos(f) Sin(t) 十 5 coS- (f) Sin(t) 


(中 xz 上 +(UVDr +( LVdrD))x =0over[ ,6] withx() = Landx(6) = 0. 


0.2913843206 cos(f) + 1.001299385 sin(f) 
万 


(ej) xx (UVDx' 二 (U/P2)xz 一 1over[0.5,4.5] with x(0.5) = 1 andx(4.5) = 2. 


xfr) 一 





xD 一 弓 0.2525826491! 2.528442297fln(D) 
2 Does the boundary value problem in Exercise 1l(e) satisfy the hypotheses of Corol- 
lary 9.1? Explain. 
3. Ha fulfills the hypothesis of Corollary 9.1, show that v(f) 三 0 is the unique solution 
to the boundary value problem 


风 =PDvGDH+9q()uG with va) =0 and up) = 0. 


Algorithms and Programs 
Ce | 


1 (3) Use Programs 9.9 and 9.10 to solve each of the boundary value problems in 
EXercise 1, using the step size 岂 = 0.05. 
(b) Graph your solution and the actual solution on the same coordinate system. 
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2。Construct programs analogous to Program 9.9 based on 
(a) Heun's method， 
(b) the Adams-Bashforth-Moulton method, and 
(c) Hamming's method. 
3. (a) ”Modify Program 9.10to call each of your Programs from Problem 2. 
(b) Use your programs to Solye each of the five boundary value problems in Exer- 
clse ] using the step Size 彤 一 0.05. 
(cj) Graph your solutions and the actual solution on the same coordinate system. 


Finite-difference Method 


Methods involving difference quotient approximations for derivatives can be used for 
Solving certain second-order boundary value problems. Consider the linear equation 


(]) Xi 一 DPCODZCD) 十 9g(CDOz(D 十 Fr(D) 


over [a,D] with x(a) = a andx(p) 三 8. Form a partition of [a,p] using the points 
Q 一 加 一 旭 二. < 办 三 , where 天 = (2 aq/Nandf = 十 Jpmfory 一 0,1， 
,AN,Thecentral-difference formulas discussedin Chapter 6 are used to approximate 
the derivatives 


(2) Xi 一 2 十 O(02) 
and 
G) xd 站) 二 XU 2x(0) 十 XGO 1 0O02)， 


72 
To start the derivation，we Feplace each term x(f) on the right side of (2) and (3) 
with xj and the resujlting equations are substituted into (1) to obtain the relation 

XiHL 251 十 2 1 2 Xj+L X1 1 2 

一 一 一 十 OO) = pi) 1 -一 一 一 十 00 
几 局 (2) = PC 5 00 

十 G(ODD2ri 十 六 (三 ). 

Next，we drop the two termas O(2) in (4) and introduce the notation 也 = 也 (人 )， 
gj = 三 4(0) andr 一 7(0);ithis produces the difference equation 


XiH+L 2 十 X) 1 Xij+L Xi 1 
(9) 一 一 性 一 5 十 gjxj 十 六 


which is used to compute numerical approximations to the differential equation (1). 
This is carried out by multiplying each side of ($) by /2 and then collecting termas 
involving xj 1 xi， andxj+land arrangingthem in a system of linear equations: 


忆 天 
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foer 了 一 12,...,N 1wherex0 一 wandxhN 一 有 .Thesystem in (6) has the familiar 
tridiagonal form, which is more visible when displayed with matrix notation': 


2+h2gi “pl 1 2 
过 pz 1 2+h2qz 4pz 1 O 22 
二 加 1 2 二 129/ 务 记 ; 1 X/ 
O 地 pw 1 2+j2qw2 pw2 1||xrv， 


Where 


玉 太 
a= (22+1s and ov=( 辽 pw +I4 


When compnutations with step size 彤 are used, the numerical approximation to the 
Solution js a set of discrete points {( 太 ,xz7) 刻 寺 the analytic solution x( 六 ) is known, we 
can compare xj and x()， 


Example 9.18. Solve the boundary value problem 





1 2X/( 人 本 xzO 十 1 
with x(0) 1.2S and x(4) 一 ”0.95 over the interval [0, 4]. 

The functions p, g, andr are p( =21/(1 二 D),g00 = 2/ 人 十 乓 ,andr() = |， 
Tespectively. The finite-difference method is used to construct numerical solutions {xy us- 
ing the System of equations (6). Sample values of the approximations {z7 让 (72 {r73}， 
and {xj 4j.corresponding to the step Sizes 瑚 ] 一 0.2, 12 一 0.1, j13 一 0.05, and j4 一 0.025 
are given in Table 9.17. Figure 9.26 shows the graph of the polygonal path formed from 
{(0,XPD] for the case jl = 0.2， There are 41 terms in the Sequence generated with 
jz 一 0.1, and the sequence {xj.2} only includes every other term from these computations; 
they correspond to the 21 values of { 姜 } given in Table 9.17. Similarly, the sequences {zj.3} 
and {xj,4} are a portion of the values generated with step sizes 13 一 0.05 and jn4 = 0.025， 
respectively, and they correspond to the 21 values of { 食 }) in Table 9.17. 

Next we compare numerical solutions in Table 9.17 with the analytic solution: x(1) 一 
1.25 十 0.486089652! ”2.25 三 十 21 arctan(t) 才 In(1 十 如 十 ln(1 十 马 ). The numerical 


(CD 一 
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(0) 





Tabile 9.17 ”Numerical Approximations for x”(1) 一 X(t 十 1 


1 十 万” 1 十 纪 
































































































. 1.250000 1.250000 1.250000 1.250000 1.250000 
0.2 1.314503 1.316646 1.317174 1.317306 1.317350 
0.4 1.320607 1.325045 1.326141 1.326414 1.326505 
0.6 1.272755 1.279533 1.281200 1.281623 1.281762 
0.8 1.177399 1.186438 1.188670 1.189227 1.189412 
1.0 1.042106 1.053226 1.05S973 1.05S6658 1.056886 
1.2 0.874878 0.887823 0.891023 0.891821 0.892086 
1.4 0.683712 0.698181 0.701758 0.702650 0.702947 
1.6 0.476372 0.492027 0.495900 0.496865 0.497187 
1.8 0.260264 0.276749 0.280828 0.281840 0.282184 
2.0 0.042399 0.059343 0.063537 0.0645S83 0.064931 
2.2 0.1706106 0.153592 0.149378 0.148327 0.147977 
2.4 0.372557 0.355841 0.331702 0.35S0669 0.350325 
2.6 0.5$7565 0.541546 0.537580 0.536590 0.5362061 
2.8 0.720114 0.705188 0.701492 0.700570 0.700262 
3.0 0.854988 0.841551 0.838223 0.837393 0.837116 
3.2 0.95S7250 0.945700 0.942839 0.942125 0.941888 
3.4 1.022221 1.012958 1.010662 1.010090 1.009899 
3.6 1.045457 1.038880 1.037250 1.036844 1.036709 
3.8 1.022727 1.019238 1.018373 1.01815S8 1.018086 
4.0 0.950000 0.950000 0.950000 0.950000 0.950000 











solutions can be shown to have error of order O(P2)，Hence reducing the step size by a 
factor of 和 results in the error being reduced by abonut 于 A careful scrutiny of Table 9.18 
will reveal that this is happening. For instance, at 六 一 1.0 the errors incurred with step 
Sizes jl, Pi2,j3,andj4 areejil 三 0.014780,ej2 = 0.003660,ej3 = 0.000913,and ej,4 一 
0.000228, respectively. Their successive Tatios ej,.2/ej1 三 0.003660/0.014780 = 0.2470， 
ej3/ej2 = 0.000913/0.003660 = 0.2495, and ej.4/ej1.3 = 0.000228/10.000913 = 0.2497 
are approaching . 

Finally，we show how Richardson's improvement Scheme can be used to extrapolate 
the seemingly inaccurate sequences {j 1 fj] 73}， and {x74] and obtain Six digits 
of precision. Eliminate the error terms O02) and O(P/2)2 in the approximations {x 7 
and {xj.2} by generating the extrapolated sequence {zj1] = {(4x 六 2 xj1D/3]. Similarly， 
the error terms O((P /2)2) and O((/4)2) for {z),2]) and {xj3} are eliminated by generat- 
ing {zj2} = {(4xj3 xx72)/3}.、 LI has been shown that the second level of Richardson's 
improvement Scheme applies to the sequences {zj.1] and {zj.2}, so the third improvement 
is {(16zj),> zj 1D/1S} (see Reference [41]) Let us ustrate the Situation by finding the 
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?= 2On) 











Figure 9.26 The graph of the numerical approximation for 
xff) 一 4) 十 Wi) which is the solution to 





(有 ) 一 -一 一 < 1 十 1 
Y 【人 [7 所 TD) 十 
(using 严 = 0.2). 
extrapolated vajues that correspond to 六 一 1.0. The first extrapolated value is 


4xj2 xj1 4(1.053226) 1.042106 
3 3 





一 1.0$6932 一 < 妃 1 。 


The second extrapolated value is 


4xj)3 Yi2 4{1.055973) 1.053226 
3 3 





一 1.050889 = zj)2. 


Finally, the third extrapolation involves the terms zj.] and zj.2: 


zj 16(1.056889) 1.056932 
5 本 15 


16z/ 
- 一 1.056886. 





二 | 


This last computation contains six decimal places of accuracy，、The values at the other 
points are given in Table 9.19. 量 


Program 9.12 w 记 call Program 9.11 to solve the tridiagonal System (6)，Pro- 
gram 9.12 requires that the coefficient functions P(i), 9(D ,and r( (boundary value 
problem (1)) be saved in M-fhiles P.m, qg.m, andr.m, respectively. 


了 Program 9.11 (Tridqiagonal Systems)，To Solve the tridiagonal system CX = 殖 ， 
where C is atridiagonal matrix. ~ 


function X=trisys(A,D,C,B) 
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Tabile 9.18 Errors in Numerical Approximations Using the Finite-difference Method 




























































(1 /2 (Ch 门 并 73 xD 站 X74 
一 如 ji7? 一 忆 ); 一 e| 
站 一 二 3 十 了 4 
j 一 0.2 jp2 一 (0.1 513 一 0.05 14 三 0.025 
0.0 0.000000 0.000000 0.000000 0.000000 
0.2 0.002847 0.000704 0.000176 0.000044 
0.4 0.005898 0.001460 0.000364 0.000091 
0.6 0.009007 0.002229 0.00055S6 0.000139 
0.8 0.012013 0.002974 0.000742 0.000185 
1.0 0.014780 0.003660 0.000913 0.000228 
1.2 0.017208 0.004263 0.001063 0.000265 
1.4 0.019235 0.004766 0.001189 0.000297 
1.6 0.020815 0.005160 0.001287 0.000322 
1.8 0.021920 0.005435 0.001356 0.000338 
2.0 0.0225333 0.005588 0.001394 0.000348 
2.2 0.022639 0.005615 0.001401 0.000350 
2.4 0.022232 0.00SS16 0.001377 0.000344 
2.0 0.021304 0.005285 0.001319 0.000329 
2.8 0.0198S2 0.004926 0.001230 0.000308 
3.0 0.017872 0.004435 0.001107 0.000277 
3.2 0.015362 0.003812 0.000951 0.000237 
3.4 0.012322 0.003059 0.000763 0.000191 
3.6 0.008749 0.002171 0.000541 0.000135 
3.8 0.004641 0.00115S2 0.000287 0.000072 
0.000000 0.000000 0.000000 








%Input  - 
%/ - 


有 
D 
从 -CC is the Superdiagonal of the coefficient zatIrixX 
B 
又 
) 


六 一 

YXDOutput -~ 

N=1length(B 

for KX=2:N 
mult=A(k-1)/D(k-1L) ; 
D(k)=D(k)-~mult*C(k-1) ; 
“BCk)=B(k)-mult*B(xk-1) ; 

end 

XCN)7=B(N)VD(CN) ; 

for KK= N-1:-: 工 
X(k)=(B(K)-C(GK)*X(K+l)7VD(CK) ; 

end 











is the Subdiagonal of the coefficient matrixX 
is the maiDn diagonal of the coefficient matrix 


is the constant Vector of the Linear System 
is the SO01Lution Vector 
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Table 9.19 ”Extrapolation of the Numerical Approximations {xj,1，{x72} {x)3} Obtained 
with the Finite-difference Method 





xf 人 (7) 
下 xact 
刀 solution 
0.0 1.230000 1].250000 1.240000 1.2S0000 
0.2 1.317360 1.317351 1.317350 1.317350 
0.4 1.326524 1.320506 1.320504 1.326S0S 
0.6 1.281792 1.281764 1.281762 1.281762 
0.8 1.189451 1.189414 1.189412 1.189412 
1.0 f.056932 1.0S6889 1.05S6886 1.0$6886 
1.2 0.892138 0.892090 0.892086 0.892086 
1.4 0.703003 0.702951 0.702947 0.702948 
1.6 0.497246 0.497191 0.497187 0.497187 
1.8 0.282244 0.282188 0.282184 0.282184 
2.0 0.064991 0.064935 0.064931 0.064931 
2.2 0.147918 0.147973 0.147977 0.147977 
2.4 0.3S0268 0.3S0322 0.350325 0.3S0325 
2.6 0.536207 0.336258 0.336261 0.336261 
2.8 0.700213 0.700259 0.700263 0.700262 
3.0 0.837072 0.837113 0.837116 0.837116 
3.2 0.941850 0.941885 0.941888 0.941888 
3.4 1.009870 1.009898 1.009899 1.009899 
3.6 1.036688 1.036707 1.036708 1.036708 
3.8 1.018075 1.018085 1.018086 1.018086 
4.0 0.9$0000 0.930000 0.930000 0.950000 















Program 9.12 (Finite-difference Method). To approximate the solution of the 

boundary value problem x”= P(DX'(CD 十 gCDxz() 十 r( with x(a) = a and 

X(D) = B over the interval [a, bp] by using the finite-difference method of order 

O(2). 

Reraark. The meshisa 三 砧 <…. < INw+l = pandthe solution points are 
“IN+1 

{(， 2Xj]=1 。 












function F=findiff(p,q,r,avb,alpha,beta,N) 


%Input -~ P,q,and rz are the coefficient functions of (1) 
input as Stringsji 2p:，,)?q; ,2T) 

共 - a and b are the left andq ITight end points 

久 - alpha=x(a) and beta=x(b) 

% - N is the number of steps 

%0Output - F=[T XI'] :where T， is the 1xN vector of abscisgsags 
久 and X， is the 1xN Vector of ordinates 
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YInitialize vectors and }? 

T=zeros (1 ,N+1) ; 

X=zeros (1 ,N-1) ; 

Va=zeros (1 ,N-2) ; 

Vb=zeros (1 ,N-1) ; 

Vc=zeros (1 ,N-2) ; 

Va=zeros(1 ,N-1) ; 

h=(b-a)V/N; 

YXCalLculate the constant vector B in AX=B 
Vt=a+h :Ph:a+hk(N-1) ; 

Vb=-h”"2*feval(r,Vt) ; 
Vb(1)=Vb(1)+(1+h/2*feval(p,Vt(1) ) )*alpha; 
Vb(N-1)=Vb(GN-1)+(1-h/2*feval(P,Vt(N-1)))*betai 
%Calculate the main diagonal of A in AX=B 
Vd=2+h“2*yfeval(qVt) 3; 

%Calculate the superdiagonal of A in AX=B 
Vta=Vt(1,2:N-1) ; 

Va=-1-h/2*feval(P ,Vta) ; 

%Calculate the subdiagonal of A in AX=B 
Vtc=Vt (1L,1:N-2) ; 

Vc=-1l+hV2*x*feval(p,Vtc) ; 

YXSolve AX=B using trisys 
X=trisys(Va,Vd,Vc,Vb) ; 

T=[a,Vt,b] ; 

X= [alpha,X,beta] ; 

F=[T，X7?]; 


了 Exercises for Finite-dqifference Methodq 


In Exercises ] through 3, use the finite-difference method to approximate x(a 十 0.5). 


(a) Let pl = 0.5 and do one step by hand calculation. Then let /2 = 0.25 and do two 
steps by hand calculation， 
(b) Use extrapolation of the values in part (a) to obtain a better approximation (i.e.， 
Z11 一 (4xj2 xj/1D/A3). 
(c) Compare your Tesults from parts (a) and (b) with the exact value x(a 十 0.5). 
1 xz 一 2x 十 三 1over[0,1] withx(0) =Sandx(D 一 10 
xD) 王妃 十 和 十 5 
2. x7 十 (1/b2 十 (1 1/(4:)x = 0over[1,6] withx(D = 1and x(6) =0 
0.2913843206 cos (f) 十 1.001299385 sin (if) 
AI 


X 人 (0 一 
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3. xy/ (LVDx' 二 (UP)x = 1over [0.5, 4.5] with x(0.5) = 1 andx(4.5) 一 2 
X 人 一 1 0.2525826491! ”2.3284422971 ljn(D) 


4。Assume that p, 9qg, and r are continuous over the interval [a, p] and that g() 之 0 for 
aa<f<D HIHAsatisfes0 < 亚 < 2/M, where M 三 maxo<r<bflPp(i|], prove that 
the coefficient matrix of (06) is strictly diagonally dominant and that there is a unique 
solution. 


SAssume that p( 人 三 CI > 0andd( 人 hn 三 C2 > 0. (a) Write out the tridiagonal linear 
System for this Situation，(b) Prove that the tridiagonal System is strictiy diagonally 
dominant and hence has a unique solution, provyided that C1/ C2 三 玉 . 


Algorithms and Programs 





1，、Use Programs 9.11 and 9.12 to solve the given boundary problem using step sizes 

瑚 = 0.1 andA = 0.01. Plot your two approximate solutions and the actual solution 

on the same coordinate system. 

(a) 太一 2x xx 十 弓 1over[0,1] with x(0) 一 Sandx() = 10 

x( 人 一 弓 十 4 十 5 

(b) xx 刀 十 (ADxz +(L LUGd2)xz =0over[1,6] withx(1) = 1andx(6)=0 

0.2913843206 cos (1) 十 1.00129938S sin (1 
VE 
(9 zx (UnDz +(UVDP2)x = 1over [0.5,4.5] with xf0.3) = 1andx(4.5) 一 2 
x(f) = 万 0.2525826491! ”2.528442297fln(1) 


了 Problems 2 through 7, use Programs 9.11 and 9.12 to solve the given boundary problem 
using step sizes 瑚 一 0.2, 瑚 一 0.1, and 六 = 0.05.， For each problem，graph the three 
solutions on the same coordinate system. 


2. 太一 ( 2/Dx' 十 (2/12)x 十 (10cos(n()))/22 over[1L 3] with x(D) = 1andx(3) = 
1 


Xf(1) 一 


3. xz= Sr 6xz 二 te 2 十 3.9cos(3f) over [0,3] with x(0) = 0.95 and xf(3) 三 0.15 
Xi 一 4x′ 4xr 十 5cos(41) 十 Sin(2b over [0,2] with x(0) = 0.75 and x(2) = 0.25 
x 妨 = 2x' 2x 十 e :+sin(21) over[0,4] with x(0) = 0.6andx(4) = 0.1 

.1 二 (2/Dz (2/t0xz = sin(D/t over[l,6] with x(]) = 0.02 andx(6) = 0.02 
， < (UVDxz' 二 (1 LU(Cd2))x = Vicos() over [1,6] with x(D) = 1.0 andx(6) = 


8，Construct a program that will call Programs 9.11 and 9.12 and carry out the extrapo- 
lation process illustrated in Example 9.18 and Table 9.19.， 


9.，For each of the given boundary value problems, use your program from Problem 8 
and the step Sizes 瑚 三 0.1, 有 = 0.03, and 六 = 0.025 to construct a table analogous 
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to Table 9.19，、Plot your extrapolated solution and the actual solution on the same 
coordinate System 
(ax 刀 =2x' xx 十 弓 1over[0,1] withx(0) =5andx() = 10 

XI 一 纪 十 4 十 5 
(人 刀 +T(GUDxT( TV = Ooverfl6]withxG) = landx(6)=0 
0.2913843206 cos (1) 十 1.00129938S sin (1) 

VE 

() xz (UVnDxz' 二 (UVPxr = 1over [0.5, 4.5] with rx(0.5) = 1andx(4.5) = 2 

x(D 三 三 ”0.2525826491f 2.528442297fln(1) 


xf) 一 
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Solution of 
Partial Differential 尼 quations 





Many problems in applied science, physics, and englineering are modeled mathemat- 
ically with partial differential equations, A differential equation involving more than 
one independent variable is called a parfialr djferenticl eqguation (PDE). It is not nec- 
essary to have taken a Specialized course in PDEs to understand the rudimentary prin- 
ciples involved in obtaining computer solutions. In this chapter we will study finite- 
difference methods which are based on formulas for approximating the first and second 
derivatives of a function，We start by classjfying the three types of equations under 
investigation and introduce a physical problem for each case，A partial differential 
equation of the form 


(]) 4 中 xx 十 了 rey 十 C 中 yy 一 Fr， yy， 中 ， 中 +，， 中 ))， 


where 4, 了 ,and C are constants, is called guasiitear. There are three types of quasi- 
linear equations: 


(2) HB2 44C < 0,the equation is called eptic. 
(3) If52 44C = 0,the equation is called parapolic. 
(4) HB2 44C > 0,theequation is called jyperpozic. 


As an example of a hyperbolic equation, we consider the one-dimensional model 
for a vibrating string. The displacement (xz, 1) is governed by the wave equation 


(9) Dairzy) 一 Tuxrt,t) for0<x<ZL and0 一 <oco， 
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1 = (xc 力 


人 -人 ~ Figure 10.1 The wave equation 
X=0 万 X= 工 models a vibrating string. 


xigure 20.2 The heat equation 
models the temperature in an 
insulated rod. 


&(0,D=ci Rod x= 世 
1 人 ( 志 , 旋 = C2 


with the given initial position and velocity functions 


xc, 0) 一 耻 (x) for fr 王 0 and 0 芭 蕊 << 工 ， 


6 
(9) tx 0) 一 8Cx) for =0 and 0<x< 工 ， 
andthe boundary values 

xz0,1)=0 for xX 一 0and0<f<oo， 
(7) 


zx( 工 ; 引 一 0 for yx 一 下 and 0 和 1 < oo， 


The constant O is the mass of the string per unit leng 由 andT is the tension in the 
string. A_ diagram of a string with fxed ends 二 the locations (0, 0) and (三 ,0) is shown 
in Figure 10.1. 

As an example ofaparabolic equation, We considerthe one-dimensional modelfor 
heat fow in an insulated fod of length 志 (see Figure 10.2). The heat equation， which 
involves the temperature &(Cx， 力 in the rod at the position x and time 上 is 


(8) Kx 站 一 GPU 人 for0<x< 工 and0<1<oco， 
the initial temperature distribution at ! 二 0 is 

(9) xx,0) = 丰 Cc) for =0 and 0<x<L， 

and the boundary values 扩 the ends of the rod are 


da0) iH(0,1) 一 Cl for x 一 0 and 0<! < co， 
K( 卫 ,四 一 C2 for xy 一 and 0<! <oco. 
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0.0 一 一 一 YY Rigure 10.3 Solution curves 
0.2 0.4 0.6 0.8 1.0 zz, y) 一 C to Laplace's equation. 





The constant K is the coefficient of thermal conductivity, co ls the specific heat, and p 
is the density of the material in the rod. 

As an example of an elliptic equation，consider the potential function x(x，y)， 
which might represent a steady-state electrostatic potential or a steady-state temper- 
ature distribution in a rectangujlar region in the plane， These situations are modeled 
with Laplace's equation in a rectangle: 


(1D) rar(tyy) 十 xyCc 攻 一 0 for0<x<1land0<y<1， 
with boundary conditions specifited: 


Ux,0) 一 Cr) fory=0and0<x<1l(onthebottom)， 
ULx, iD 一 户 x) fory=1land0<xy<1l(onthetop)， 
zt(0, yy) 一 (OO) forxr=0and0<y<1(ontheleft， 
zy)=ROo) forx=land0<y<1(ontheright， 
A contour plot for (xz, y) with boundary functions 户 (xz) = 0, PCx) = sin(rz)， 


.PPO) = 0 and HA(y) = 0 over the square 尺 = 王 {(y):0<x<10<y<1is 
shown in Figure 10.3. 


Hyperbolic Equations 


Wave Equation 


As an example of ahyperbojlic partial differential equation, we consider the wave equa- 
tion 


(]) Mir(X 1) 一 C2xsy(x， Ifor0<x<aand0<1!L<P 
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Rigure 10.4 The grid for solving 
xirltD 一 cuxr(xy 有 over 玉 . 





with the boundary conditions 


txt(0,0=0 and  xa,=0 for0<1<p， 
(2) Ux, 0) = Jr) for 0<x<a， 
ar(z,0) 一 8) for 0 <x< ad. 


The wave equation models the displacement x of a vibrating elastic string with fxed 
ends at x 三 0 andx = Although analytic solutions to the wave equation can 
be obtained with Fourier series，We use the problem as a Prototype of a hyperbolic 
equation， 


Derivation of the Difference Equation 


Partition the rectangleR= {n0D :0<x<a0<fI<bintoagridconsisting of 
7 1by 1lrectangles with sides Ax = 关 andAf 三 上 as shownin Figure 10.4. Start 
at the bottom row, wheret 三 所 三 0andthe solution is knownto be xc,) 一 了 (xi)， 
We shall use a difference-equation method to compute approximations 


{ 下 2.7]insuccessiveIows for /一 2，3，. ..， 隐 . 


The true solution value at the grid points is wx (xi 妆 ). 
The central-difference formulas for approximating krr(z, 四 and kxxr(Cr,i) are 


U(xi 十 向 2r(x ,人 十 xc 有 问 


G) ucnD= 了 +O(P) 
and 
罗 wx 人 二 UL 十 户 ,1 站 2U0 1 十 KE 天, 放 十 OU2)， 


瑚 2 
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2 
01 1 





Figure 10.S The wave equation 
stencll， 


一 丰产 1 


The grid spacing is uniform in every rowW; Xi+1 王石 十 六 (andxi 1 一 大 四 ;anditis 
uniform in eyery column: t+1 三 刀 二 大 (and 太 1 三 万 有 .Next we dropthe terms 
O( 妃 ) and O(p2) andusethe approximation ij for (xi 三) in equations (3) and (4)， 
which in turn are Substituted into (1); this produces the difference equation 


5 六 1 27 十 时 12024077 十 本 

9 站 

which approximates the solution to (1). For convenience, the substitution y 一 cK/ 户 i 
introduced in ($), and we obtain the relation 


2 
(0) .ji 2 十 2 1 三 六 (OH 2 十 二 1) 


Equation (6) is employed to find row 7 十 1 across the grid, assuming that approxima- 
tions in both rows j and 1 are known' 


(7) 二 /1 三 (2 27o 十 天 Go 十 在 工 站 1 


fori 王 2, 3, .7 1.Thefourknownvalues ontheright side ofequation (7), which 
are used to create the approximation 必 , /1, are Shown in Figure 10.5. 

Caution must be taken when using formula (7). If the error made at one stage of 
the calculations is eventually dampened out, the method is called stable. To guarantee 
stabiiity in formula (7), it is necessary that r 一 ckK/ 有 7 < 1. There are other schemes， 
called implicit methods, that are more complicated to implement, but do not have sta- 
bility restrictions for r (See Reference [90]). 


Starting Values 


Two starting rows of values corresponding to / = 1 and j) = 2 must be Supplied in 
order to use formula (7) to compute the third row. Since the second row is not usually 
given, the boundary function 8g(x) is used to help produce starting approximations in 
the second row. Fix x 一 Xi at the boundary and apply Tayior's formula of order 1 for 
expanding UL(x,1) about (xi, 0). The value xi 提 Satisfies 


(8) 2 有 一 20 0) 二 OO 二 OO) 
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Then use xi 0) = fo) = 廊 andoi0) = 80i) = Siin(8)to produce the 
formula for computing the numerical approximations in the Second row: 


(9) 2 一 方 +Kei for 工 ==2 3 .7 1. 


Usually，x(ci 2) 关 呈 2，and such errors introduced by formula (9) will propagate 
throughout the grid and will not be dampened out when the scheme in (7) is imple- 
mented. Hence it is prudent to use a very Small step size for K so that the values for 
22 given in (9) do not contain a large amount of truncation error. 

Often, the boundary function 让 (x) has a second derivative 六”(xr) over the interval， 
In this case we have xxxr(x,0) = (xj, anditis beneficial to use the Taylor formula 
of order 7 三 2 to help construct the second row. To do this, we go back to the wave 
equation and use the relationship between the Second-order partial derivatives to obtain 


Gd0 ws0=cuauon 0=cPGob= ct 上 OU)， 


Recall that Taylor's formula of order 2 is 


(1 了 1 2 大 ) 一 2(C,0O) 十 2 人 x,0)K 天 十 


2 
2 号 OOe +， ooe)， 


Applying formula (11) atx 一 xi,together with (9) and (10), we get 
C212 2 
02) 00 间 三 户 十 K8i 十 Cl 2 二 六 D+OU )O(2) + 0O(B). 


Using r = cK/A, formula (12) can be simplified to obtain a difference formnula for the 
improved numerical approximations in the second row': 


2 
(13) ui2 一 (1 门户 + 十 二 (PH 十 及 ) 


for =2,3,... ,7 1. 


D?Alembert's Solution 

The French mathematician Jean Le Rond d'Alembert (1717-1783) discovered that 
(14) xx;1 一 Fe+cD+TGO ch 

is a solution to the wave equation (1) over the interval 0 < x < aq, provided that 


严 , 天 Gand Call exist and 严 and G have period 2a and obey the relationships 
EC 2= FFz,Fz+24a)=Fz)G(O z) = GandG(z+2a = G(z)for 
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all z. We can check this out by direct substitution. The second-order Partial derivatives 
of the solution (14) are 


(15) 2 人 二 cz2FXx 十 cb 十 c2G40 cn)， 
(16) Max 人 一 严 " (十 cf 十 GO ch). 


Substitution of these quantities into (1) produces the desired relationship: 


pr 有 二 cz2F chb 上 cc cn 
=c2(FZGx 二 cf 十 GO cn) 


一 c2xxxy (xc 四 . 


The particular solution that has the boundary values x(x,0) = jx) and xx 0 一 0 
requires that CC) 一 GC() = jx)/2 andlis left for the reader to verify. 


Two Exact Rows Given 


The accuracy of the numerical approximations produced by the equations in (7) de- 
pends on the truncation errors in the formulas used to convert the partial differential 
equation into a difference equation. Although it is unlikely to know values of the exact 
solution for the second row of the grid, if such knowledge were available, using the 
incrementK 三 cj along the 1-axis will generate an exact solution at all the other points 
throughout the gmd. 


Theorem 10.1. Assume that the two rows of values 好 1 一 UO0 ,0) and 由 2 = 
MO j) fori 一 1 2,，...，P are the exact solutions to the wave equation (1). If the 
step size 大 一 有 /cis chosen along the f-axis, theny 一 ] and formula (7) becomes 


(17) 8.j+LT 一 ML 十 1) 1 


Furthermore, the finite-difference solutions produced by (17) throughout the grid are 
eXact Solution values to the differential equation (neglecting computer round-offerror). 


Proof Use dAlembert's solution and the relation ck = P. The calculation zi ct 六 一 
GD co D= DO DA=G JPandasimilaroneproducing 


Xi 十 cfj 一 (二 2)7areusedin equation (14)to producethe following special form 
of 2 六 


(18) bj = 万 和 十 GOG 十 7 2)1)， 


for li = 1 2 ... ,mandj 一 1 , 2 ...，7m， Applying this formula to the terms 
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ZL 2 1,)， and zi 1 On the right Side of (17) yields 


Mi 十 下 1 2 1 
一 FIG 十 1 门 六 +FEGG 1 方 队 
EU GO DDNDD+TCGT+1I+7 7 及 
+CU 1+) 21 CCG+ 1 2)7) 
=FGC GTILD) 了 十 CCG 二 十 1 力 有 三 二 六 b 


for = 1,2,... ,11andy 一 1,2,...，7 有 7. @ 


Warning. Theorem 10.1 does not guarantee that the numerical solutions are exact 
when numerical calculations based on (9) and (13) are used to construct approxima- 
tions Mi2 iD the Second row， Indeed, truncation error will be introduced 诺 必 2 居 
UL(xi,K) for Some 1， where ] < 1 < 1，This is why we endeavor to obtain the best 
possible values for the second row by using the Second-order Taylor approximations in 
equation (13). 


了 Example 10.1， Use the finite-difference method to solve the waveequation for a vibrating 
String: 


(19) urr(x TI) 一 4Uxrxx,) for0<xz<land0< /<0.5， 


with the boundary conditions 


zt(0,0)==0 and zx,D=0 for0 < 上 <0.$， 
(20) U(x,0) 一 xz) 一 Sin(TY) 十 Sin(2rx) for0 <x<1， 
Url,0) 一 8C) 一 0 for0 <x<1. 


For convenience we choose 疡 = 0.1 and 大 = 0.05. Since c = 2, this yields r 一 
cr /三 2(0.05)/0.1 = 1. Since 8C) 一 0andr = 1,formula(13) for creating the second 
IOW is 
_ 帮工 Ht 

2 


Substitutingy = 1 into equation (7) gives the simplitied difference equation 


(2 有 1 2 


(22) 有 /1 一 下 HL 十 不 矿 1 


Applying formulas (21) and (22) Successively to generate rows will produce the approxi- 
mations to xc, D given in Table 10.1 for0 < 反 <1and0< 刀 <0.50. 

The numerical values in Table 10.1 agree to more than six decimal places of accuracy 
with those obtained with the analytic solution 


&G hb) 三 Sin(TX)cos(27f) 十 Sin(27rx)cos(47rD， 
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el0.1 Solution of the Wave Equation (19) with Boundary Conditions (20) 






























































































2X2 X3 X6 
| 一- 
0.896802 | 1.538842 1.760074 1.338842 1.000000 | ”0.363271 0.363271 
0.769421 1.328438 1.538842 1.380037 | 0.951056 | ”0.428980 0.210404 
0.431636 | 0.769421 0.948401 0.951056 | 0.809017 | 0.587785 . 0.181636 
0.000000 | “0.051599 | 0.181636 | 0.377381 | 0.587785 | 0.740653 | “0.769421 0.639384 
0.380037 | 0.587785 | ”0.519421 0.181636 | 0.309017 | ”0.769421 1.019421 0.9$1056 
0.587785 | 0.951056 | ”0.951056 | 0.587785 | 0.000000 | 0.587785 | 0.951056 | 0.951056 
0.371020 | 0.951056 1.019421 0.769421 | 0.309017 | 0.181636 | 0.519421 0.587785 
0.363271 | 0.639384 0.740653 | 0.587785 | 0.377381 0.181636 | 0.051599 
0.068364 | 0.181636 0.587785 | 0.809017 | 0.951056 | 0.948401 0.769421 
0.181636 | ”0.210404 0.428980 | ”0.951056 | 1.380037 1.338842 1.328438 
0.278768 | 0.363271 0.363271 1.538842 1.760074 1.538842 











Figure 10.6 ”The vibrating string for equations (19) and (20). 


Athree-dimensional presentation of the data in Table 10.1 is given in Figure 10.6， 国 
Example 10.2， Use the finite-difference method to solve the wave equation foravibrating 
String: 
(23) 2ir(xz,1 世 一 4txx(xi) for0<x<1land0<<!t<10.5， 
With the boundary conditions 

txtf0, 力 =0 and xd,0=0 for0<!<1， 


蕊 for 0 
24 ,0) 一 一 
(4 “0 一 7 CD) 1.$ 1.Sxy for 


urx,0) 一 8(C)=0 for 0<x<1. 
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Table 10.2 ”Solution of the Wave Equation (23) with Boundary Conditions (24) 











Figure 10.7 ”The vibrating string for equations (23) and (24). 


For convenience we choose 瑚 = 0.1 andK = 0.05. Since c = 2, this again yields 
六 一 1].Applying formulas (21) and (22) successively to generate rows will produce the 
approximations to wx,D given in Table 10.2 for0< 刀 二 1and0< 一 1 < 0.S0. A three- 
dimensional presentation of the data in Jable 10.2 is given in Figure 10.7. 司 


Program 10.1 approximates the solution of the wave equation ((1) and (2)). Athree- 
dimensional presentation of the output matrix U can be obtained by using the com- 
mands mesh(U) or surf (U). Additionally, the command contour (U) will produce a 
graph analogous to Figure 10.3, while the command contour3(U) will produce the 
three-dimensional analogy of Figure 10.3. 
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Program 10.1 (Finite-difference Soljution for the Wave Equation)。 To approx- 
imate the solution of iir (xc, 用 = c2uxx0t,t) over 尺 = 人 CD:0<x<a0< 


1 < 0 with x(0,r) = 0 xb 一 0for0<L < Dandxtx,0) 一 oo)， 
MO 一 SO for0O<x <4， 





function U = finedif(f,g,a,bic,D, 联 ) 


%Input - f=u(xX,0) as a StIring )f) 


办 -~ g=ut(x,0) as a string :8g， 

包 - a and b right end points of [0,a] and [0,b] 

为 -~ Cc the constant in the WaVe equatioD 

% ~ mn and am number of grid Points over [Lo0,a]j and [0,b] 


XiOutput - U solution matrix; analogous to Table 10.1 


XInitialize parameters and U 
h=a/ (n-1) ; 

K=b/ (m=-1) ; 

T=CykKXA/h ; 

IT2=T 2; 

Tr22=Tr”2/2; 

81=1-~T 2; 

S2=2-2*Tr “2 ; 

U=zeros (mn ,ma) ; 


XCompute first and Second Tows 
for ii=2:D-1 
U(i,1)=feval(f ,hyx(i-1) ) ; 
U(Ci,2)=sl+feval(f,hy(i-1))+k*yfeval(g,hy(i-t)) 
+tr22k(feval(f ,hyi)+teval(f,hy(i-2)7)7); 
endQ 


VCompute remaining rows of TU 
for j=3:m， 
for i=2: (n-1) ， 
U(4i,j) = s2*U(i,j-1)+r2*(U(i-1,j-ti)+U(Gi+t,j-1))-U(Ci,j-2) ; 
end 
end 


U=U? ; 
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了 Exercises for Hyperbolic 了 Equations 





1，(a) Verify by direct substitution that wx(xz,r) 一 Sin(TxX)cos(C2ATr) is a solution to 
the wave equation urr(r yt) 一 4Uvx(x,t)foreachpositive integer] 一 1 2,.... 
(b) Verify by direct Substtution that Kx 办 一 SinGaTXY)cos(cnTt) 认 asolution 


to the wave equation urr(x 1) 一 C22 er(x， 1) for each positive integer 7 = 1， 
2,...， 


2， Assume that the initial position and velocity are ur,0) 三 jc) and ,0) 
TIespectively. Show that the d "Alembert solution for this case is 
jxT+Tcn+ae cb 
四 2 
3. Obtain a Simplifed torm of the difference equation (7T) in the case 玉 一 2cK， 


0， 


机 


&(.r) 一 





In Exerclses 4 and 9,use the finite-difference method to calculate the first three IOows of 


the approximate Solution for the given wave equation. Carry out your calculations by hand 
(calculator)， 


4.2U1rCc1) =4Urx(t tfor0<xz<1land0<!<0.5,withtheboundary conditions 
zu(0.1) = 一 0 and xz,D=0 for0 < < 0.5， 
Mox,0) 一 Jx)=Sin(ry) for0O <x< 芝 | 
xzrx,0) 王 8) 一 0 for0 < 二 工 . 
Letm =0.2, 大 三 0.1,andr 三 |. 
Surr(x1) =4uUxrr(xtt,for0<x<land0<r<0.3,with theboundary conditions 


2(0, 四 =0 and Ai)= 王 0 for0<r<0.5， 


Sx 3 
了 for 0< 工 苹 
&w(X ,0O) 一 (7 一 
全 一 帮 15$ 1Sx 3 
一 本 for 5 <x < |， 


itrx,0) 一 8a)= 王 0 for0<xv< 一 1. 
Let 严 一 0.2, 大 一 0.1andr 一 1. 


6.Assume that the initial position and velocity are (xz, 0) = jx) and ix,U) 一 80)， 
Iespectively. Show that the d Alembert Solution for this case is 
f 1 1 fc 
wocD 二 十 CDD 十 7 cD | 1/ 
2 2c 人 
7.、Forthe equation Upr(x,t) 一 9uxx( 人 xD Whatrelationship between 户 andK must Ooccur 
in order to produce the difference equation 由 ji+1 三 241 十 丰 1 机 六 1 





8089)d5. 


ef 


8. What difficulty might occur when trying to use the finite-difference method to solve 
arr(xyr) 一 44rr(x,f) with the choice 天王 0.02 and 记 =0.03? 
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Algorithms and Programs 





In Problems ]l to 8, use Program 10.1 to solve the wave equation xirr(xz,t) 一 C22xx (xc 四， 
for0<x<aand0<!<pb,withthe boundary conditions 
zt(0,bI 一 0 and xd,1) 一 0 for 0<!<D， 
MU,0) 一 三 (x) for 0<x<a， 
Urxt,0) 一 8(Cr) for 0<X <a， 


for the given Values，Use the surf and contour Commands to plot your approximate 
SoOlutions， 


1. Usea 一 1 一 jc=1 6)=sin(rx),andg(x) 0. For convenience, choose 
瑚 = 三 0.1and 大 三 0.1. 


2. Usea 一 1 一 jc 三 1， jz) 开工 X2, and 8(x) 三 0. For convenience, choose 
天 一 0.1 and 大 一 0.1. 
3. Used 一] 一]1c 王 1， fox) = 


38) 三 0, 一 0.1,andK 一 0.1. 
。Usea 一 1 一 lc 一 2, Fr) 一 Sin(rx),gx) 一 0. 关 =0.1,and 大 一 0.05. 
.Usea=18=1c=2,F00) 一 xz 2180)=0, 及 =0.1andk=0.05， 
。Repeat Problem 3, but with c 一 2 andK 三 0.05. 
。 及 epeat Problem 1, but with 帮 (x) = sin(2rx) 十 sin(47rx). 


色 vv 人 nn 和 全 


。Repeat Problem 1, but with c = 2，j (xx) = Sin(2rx) 十 sin(47rx),andK 一 0.05， 


Parabolic Equations 


_Heat Equation 


As an example of parabolic differential equations，we consider the one-dimensional 
heat equation 


(]) ， 2 人 一 C2axxrOxz， 人 for0<x<aand0<! 上 <， 


with the initial condition 


(2) UL 0) 三 Foc) forr=0and0<xv<a， 
and the boundary conditions 
G) MU(0, 站 一 8I( 人 三 cl forxy 一 0and0<t<pb， 


ua,1) 三 82( 人 三 cC2 forx=aand0<!<b. 
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1 


太 1 | 

















Figure 10.8 The grid for solving 


XI 总 -1 扰 AH+1 mr 和 二 czxr(Oc 有 over 尺 . 


The heat equation models the temperature in an insulated rod with ends held at con- 
stant temperatures Cl and c2 and the initial temperature distribution along the rod be- 
ing jx). Although analytic solutions to the heat equation can be obtained with Fourier 


Series, We use the problem as a prototype of a parabolic equation for numerical solu- 
tion. 


Derivation of the Difference Equation 


ASssume that the rectangle 尺 ={ 人 rt) :0<xy<a0<r<bissubdivided into 
1 tby 姑 1rectangles with sides Ax 一 岂 and Al 一 太 asshownin Figure 10.8， 
Start at the bottom row. Where ! 三 下 三 0, and the solution is COci 二 ) 一 Fi) A 
method for computing the approximations to (xz, 1 at grid points in successive IOWS 
fc 一 12, .1fory 一 2,3,. .7 wWil be developed， 

The difference formulas used for 2 (xb andxxxy(x 力 are 


MU 十 2，D 


(4) Mr (xs 六 二 


十 OF) 
and 


MX 天 1 2U0r 门 十 2 十 天 ,让 


G) wxxCx, 间 一 


上 + OP) 
Thbe grid Spacing is uniform in every IOow: XI 三 姑 十 关 (andxi 1 三 厂 有 and 
itis uniform in every column: 1j+1 一 刀 十 开 Next we drop the terms O( and O(022) 


and use the approximation ri j for ke) in equations (4) and (9)， which are in turn 
substituted into equation (1) to obtain 


0 同 半 1 2 2 2 十 让 二 17/ 
天 2 ， 


-一 -一 一 一 一 一 一 一 一 一 一 一 一 一 
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尼 , 六 1 


1， 


六 1 ”17 Figure 10.9 The forward differ 
(一 27)i4 1 
， ence Stencil. 


which approximates the solution to (1 上 ). For convenience, the substitution r 一 < 和 / 1 
is introduced in (6), and the result is the explicit forward-difference equation 


(7) 上 1 一 (人 21) 有 十 Fi 1 十 上 + 让. 


Equation (7) is employed to create the (j) 十 H)th row across the grid, assuming that 
approximations in the jth row are known. Notice that this formula explicitly gives the 
value 丰 ,JEintermns of 1 放 必 六 and 必 + 六 Thecomputationalstencil representing 
the Situation in formula (7) is given in Figure 10.9. 

The simplicity of formula (7) makes it appealing to use， However it is impor- 
tant to use numerical techniques that are stable. If any error made at one Stage of 
the calculations is eventually dampened out, the method is called stable. The explicit 
forward-difference equation (7) is stable 让 and only if r is restricted to the interval 
0< 六 芭 放 . Thbis means that the step Size 大 must satisfyK < 12 /1(2c2). If this condition 
is not fulfilled, errors committed in one line { 必 站 might be magnified in subsequent 
lines {ip] for some P > 六 The next example illustrates this point. 


了 Exampjie 10.3. Use the forward-difference method to solve the heat equation 
(8) dr 1i) 一 xxr:I) for0<xz<land0< <0.20， 
with the initial condition 

(9) wx;0) = Fo)=4r 4r forr=0and0<xr<1， 
and the boundary conditions 


&U(0, 站 一 glIO=0 ftorxy=0and0<71<0.20， 


(10) 
UL, 门 王 82( 扩 三 0 forx 一 land0<1<0.20. 


Eor the first jilustration, we use the step Sizes Ax 一 忆 =0.2 and Ar 一 大 = 0.02 and 
c 一 1, So the ratio is 7 = 0.3. The grid will be 一 6columns wide by mm = 11 rows high. 
In thijs case, formujla (7) becomes 


1 十 +/ 
GD wj 一 一 人 7 
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Table 10.3 .Using the Forward-difference Method with r = 0.5 
加 x 一 000 | =020 | 妈 =040 | 忆 =060 | =080 | x=1.00 
11 一 0.00 | 0.000000 | 0.640000 0.960000 0.960000 5640000 0.000000 
D 一 0.02 0.000000 0.480000 0.800000 0.800000 0.480000 0.000000 
语 一 0.04 」 0.000000 0.400000 0.640000 0.640000 0.400000 0.000000 
丰 三 0.06 | 0.000000 0.320000 0.520000 .| 0.520000 0.320000 0.000000 
65 一 0.08 0.000000 0.260000 0.420000 0.420000 0.260000 0.000000 
6 三 0.10 | 0.000000 0.210000 0.340000 0.340000 0.210000 0.000000 
妃 一 0.12 0.000000 0.170000 0.275000 0.27S000 0.170000 0.000000 
如 三 0.14 | 0.000000 0.137500 0.222500 0.222500 0.137500 0.000000 
1 一 0.16 | 0.000000 0.1112S0 0.180000 0.180000 0.1112S0O 0.000000 
:10 三 0.18 0.000000 0.090000 0.143625 0.145S625 0.090000 0.000000 
111 =0.20 | 0.000000 0.072812 | 0.117813 0.117813 0.072812 0.000000 

















Eigure 10.10 Using the forward difference method with r = 0.5. 


Formula (11) is stable forr = 0.5 and can be used successfully to generate reasonably 
accurate appIOximations to UL(xz,1)，Successive rows in the grid are given in Table 10.3. 
A three-dimensional presentation of the data in Table 10.3 is given in Figure 10.10. 

For our Second ustration, we use the Step sizes Ax 一 玉 一 0.2and Ar = 大王 起 入 
0.033333, So that the ratio is r = 0.833333. In this case, formula (7) becomes 
(12) 


MP 二 LE 一 0.606665o 十 0.833333(0i 1 十 2 二 1, 门 ， 
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Table 10.4 Using the Forward-difference Method with r = 0.833333 



























2X2 一 0.20 | 2 = 0.40 
-| 
1 一 0.000000 0.640000 | ”0.960000 | 0.960000 | 0.640000 
刀 一 0.033333 0.373333 | 0.693333 0.693333 0.373333 | 0.000000 


已 = 0.066667 
妈 二 0.100000 
1 二 0.133333 
16 二 0.166667 
轧 = 0.200000 
妇 = 0.233333 


0.328889 | ”0.426667 | ”0.426667 
0.136296 | 0.345185 | ”0.345185 
0.196790 | 0.171111 | 0.171111 
0.011399 | 0.1925S10 | 0.192S10 
0.1S2826 | 0.041584 | “0.041S84 
0.067230 | 0.134286 | ”0.134286 


0.328889 | 0.000000 
0.136296 | 0.000000 
0.196790 | 0.000000 
0.011399 | 0.000000 
0.1S2826 | 0.000000 
0.067230 | 0.000000 




















加 三 0.266667 0.156725 | 0.033644 | ”0.033644 | 0.156725 | 0.000000 
1!10 一 0.300000 0.132520 | 0.124997 | 0.124997 | 0.132520 | 0.000000 
四 1 一 0.333333 0.192511 | 0.089601 | 0.089601 0.192511 














Figure 10.11 Using the forward difference method with r 三 
0.833333， 


Formula (12) is unstable in this case, because 六 > 计 ， and errors committed at one row will 
be magnified in successive rows. Numerical values that tur out to be imprecise appProx- 
imations to xxb for0 < 上 < 0.33333, are given in Table 10.4. A three-dimensional 
Presentation of the data in Table 10.4 is given in Figure 10.11， 国 


The difference equation (7) has accuracy of the order 0O( 虽 十 0(12. Because the 
term O(K) decreases linearly as tends to zero, it is not surprising that it must be made 
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small to produce good approximations,. However the stability requirement introduces 
further considerations，Suppose that the solutions over the grid are not sufficiently 
aceurate and that both the increments Axy = Ao and Af = 癌 must be reduced. For 
Simplicity, Suppose that the new x increment is Ax 一 11 = Ano/2. Ifthe same ratio 
is used, K1 must Satisfy 


raD2 rao2 多 








II 人 

This results in adoubling and quadrupling ofthe number of grid points along the x-axis 
and f-axis, respectively. Consequently, there must be an eightfold increase in the total 
computationajl effort when reducing the grid size in this manner This extra effort is 
usually prohibitive and demands that we explore a more efficient method that does not 
have stability restrictions. The method proposed will be implicit rather than explicit. 
The apparent rise in the level of complexity will have the immediate payoff of being 
unconditionally stable. 


The Crank-Nicholson Method 


An implicit scheme, invented by John Crank and Phyllis Nicholson (see Reference 
[29]), is based on numerical approximations for solutions of equation (l) at the point 
(ct 十 /2) that lies between the rows in the gid. Specifically, the approximation used 
for zxr(x,t 十 K/2) is obtained from the central-difference fornnula， 


(13) 本 (人 = 0 


The approximation used for xx(Cc,t 十 大 /2) is the average of the approximations 
Uxx xz,t) and xxr(x,t 十 )， which has an accuracy ofthe order O(P2): 
开 1 
G4) zxr | xf 十 本 = 72 人 Pt 十 有 2U(xf 十 下 十 KG 十 天 十 好 
十 EC 及 有 2 人 十 ULCc 十 户 仆 ) 十 OO 
In afashion similar to the previous derivation, we substitute (13) and (14) into (1) and 


neglectthe errorterms DO(p2) and O( 人 2). Then employing the notation zi,j 一 COcit 让 
will produce the difference equation 


狼人 2 2 十 焉 HH 十 下 1 222 十 感 + 
(0 


Also, the substitution r = c2K/p2 is used in (15). But this time we must solve for the 
three yetto be computed”values 由 1, 下 /1 and ai. This is accomplished 
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2i-1, 翔 1 | &i+1 .上 
名 一 一 一 一 RE : 
Figure 10.12 The Crank- 
1 ， 了 L 。 。 
盖 1 ,7 7/ +lL/ Nicholson Stencil. 


by placing them all on the left slide of the equation. Then rearrangement of the termas 
in equation (19) results in the implicit difference formula 


(10) Fr 1 十 (2 十 27) 半 1 Pa HH 
一 (2 217) 而 十 FT 十 矶 上 1 站 


for = 2.3,.. ,7 ， 1. Theterms onthe right-hand side of equation (16) are all 
known， Hence the equations in (16) form a tridiagonal linear System 4 天 = 及. The 
Sjx points used in the Crank-Nicholson formula (16), together with the intermediate 
grid point where the numerical approximations are based, are Shown in Figure 10.12. 

Implementation of formula (16) is sometimes done by using the ratio r = 1. In 
this case the increment along the r-axis is Ar 一 大 = 良 /c2, and the equations in (16) 
Simplify and become 


(17) 有 TiHL 十 4 和 下 HE 二 在 十 让 1 
for7 三 2,3,... ,7 1.Theboundary conditions are used in the first and last equations 


(Le alj = UJ+1 一 clandzny) 三 贡 闭 1 三 Crespectively), Equations (17) are 
especiajly pleasing to view in their tridiagonal matrix form 4 三 一 吾 . 


1 12. /1 2c1 十 23./ 
1 4 1 O 13,j 二 [ &2.) 十 U4,/ 
1 4 1 Up.j+L | 三 | ap 47 十 Up+Ly 
O 1 4 1 2 Un 3 十 1 
1 4|11 丰 7+I tn 2 十 2C2 


When the Crank-Nicholson method is implemented with a computer, the linear system 
4 到 一 及 can be solvedby either direct means or by iteration. 
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Table 10.S 


站 
刀 2 
妃 
14 
好 
6 
她 
如 
1 
110 
1 


The Values 6 , 太 ) Using the Crank-Nicholson Method with 六 = (7 





xX2 一 0.1 


1.118034 
0.616905 
0.394184 
0.288660 
0.233112 
0.199450 
0.175881 
0.157405 
0.141858 
0.128262 
0.116144 


了 上 xaimple 10.4.。 Use the Crank-Nicholson method to solve the equation 


(18) 


23 一 0.2 


1.338842 
0.928778 
0.647957 
0.306682 
0.425766 
0.372035S 
0.331490 
0.29813 主 
0.269300 
0.243749 
0.220827 


rc 1 一 2xxz 人 (六 


X4 一 0.3 


1.118034 
0.862137 
0.718601 
0.625285 
0.556006 
0.499571 
0.451058 
0.408178 
0.369759 
0.335117 
0.303787 


X5 一 0.4 


0.363271 
0.6176539 
0.680009 
0.666493 
0.625082 
0.575402 
0.525306 
0.477784 
0.433821 
0.393597 
0.356974 


X6 一 0.5 


0.000000 
0.490465 
0.648834 
0.673251 
0.645788 
0.600242 
0.550354 
0.501545 
0.455802 
0.413709 
0.375286 





with the initial condition 


〈19) 


uCx,0) 一 Fx) 三 sin(rx) 十 Sin(37z) 


and the boundary conditions 


x(0,D =81O=0 
&(1L 疙 三 82 人 坊 =0 


X7 一 0.6 


0.363271 
0.617659 
0.680009 
0.666493 
0.625082 
0.575402 
0.525306 
0.477784 
0.433821 
0.393597 
0.3S6974 


x8 一 0.7 


1.118034 
0.862137 
0.718601 
0.625285 
0.556006 
0.499571 
0.45S1058 
0.408178 
0.369759 
0.335117 
0.303787 


S33 
1)7/100 
xg 一 0.8 xl0 一 0.9 
1.538842 ”1.118034 
0.928778 ”0.616905 
0.647957 “0.394184 
0.506682 “0.288660 
0.425766 ”0.233112 
0.372035 “0.199450 
0.331490 ”0.17S881 
0.298131 “0.1S7405 
0.269300 ”0.14185S8 
0.243749 “0.128262 
0.220827 “0.116144 





for0<x<1l and0 一 上 <0.1， 


for x 一 0 and 0< 上 <0.1， 
for xy 一 1 and0<!<0.1. 


for !=0 and0<Y<1. 


For simplicity，we use the step Sizes Ax 一 天 一 0.1andAf 一 大 一 0.01 sothatthe 
ratio is r = 1. The grid will be 夯 一 11 columns wide by m = 11 rows high, Applying the 
algorithm generates the values in Table 10.S for0 < 拉 < 1and0< 必 三 0.1. 

The values obtained with the Crank-Nicholson method compare favorably with the 


analytic solution Kx, 站 一 Sin(rx)e 工 2 十 sin(3rx)e 9m2， the true values for the hnal 


row being 





1t1 0.115285 0.219204.， 0.301570 0.354385 ”0.372569 ”0.354385 0.301$70 ”0.219204 0.115285 





Athree-dimensional presentation of the data in Table 10.S$ is given in Figure 10.13， 上 





Program 10.2 (Forward-difference Method for the Heat Equation). To approx- 
imate the solution of zw (x, 站 一 c2xoxr(OxDover 尺 一 {(x 六 :0<<a0<1 < 
站 with kx ,0) = foo, for0 < xx<aandx(0.0 一 cl uan = co for 


0<!< 


2. 


function U=forwdif(f,cl,c2,a,b,c,n)m) 
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%Input 
久 
名 


1 


Output - 





Figure 10.13 2 三 400 六) from the Crank-Nicholson method. 


f=u(x,0) as a String ff) 
cl=u(0,t) and c2=u(a,t) 


a and b right end Points of [0,a]j and [0,b] 


c the congstant in the heat equation 


n and mm number of grid Points over [0,a] and [0,b] 
U solution matrix;i analogous to Table 10.4 


YIDitialize Parameters and U 


hb=a/ Cn-1) ; 
k=by/ (m-1) ; 


IT=c”2*#*k/h>2; 


S=1 一 2:# 


工 ? 


U=zeros (mn ,也 ) ; 


YBoundary conditions 

U(1,1:m)=cli 

Un ,1:m)=c2; 

%Generate first Tow 
U(2:n-1,1)=feval(f,n:h:(n-2)xh)，; 


VhGenerate Temaining IowS of TU 


for j=2:zm 


for =2:D-1| 


end 


U(i,j)=syU(i,j-1l)+r*(U(i-i,j-1)+UCi+l,j-1)); 
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end 
U=U)， ; 






Program 10.3 (Crank-Nicholson Method for the Heat Equation). To approx- 
imate the solution of vi (x, 7) 一 C2xrxCc， 门 Over 丸 一 {(x:1 站 :0 和 YY<a,0< 
1 < 中 with xz,0) = Ja)for0O0 <x<aandux0.0) 三 cl ua,b 一 c,for 
0<1<. 


function U=crnich(f,cl,c2,a,b,c,Dn,m) 


%Input ~- f=u(x,0) as a string :了 工 ， 


% - cl=uk0,t) and c2=u(a,t) 

台 - a and b Tight end points of [0,a] and [0,b] 

久 - c the constant in the heat equation 

多 -mn andmmnumber of grid points over [0,a]l and [0,b] 


XkOutput - U solution matrix; analogous to Table 10.5 


XInitialize parameters and U 
h=a/(n-1) ; 

kk=b/V(m-1) ; 

T=Cc”2*+xk/h “2; 

S1=2+2/r; 

S2=2/r-2; 

U=zeros (D,m) ; 

YX%Boundary conditions 
U(1,1t:m)=cl; 

Un ,1:m)=c2; 

YGenerate first ToWw 
U(2:n-~l,1)=feval(f,h:bh:(n-2)*xh); 


MPForm the diagonal and off-diagonal elements of A and 
人 the constant Vector B and solve tridiagonal System AX=B 
Vd(1,1:n)=strkones(1,n) ; 
Vda(1)=1; 
VdCn)=1; 
Va=-~ones(1,n-1) ; 
Va(Cn-1)=0; 
Vc=-ones(1 ,n-1) ; 
Vc(1)=0; 
Vb(1)=c1l; 
VbGn)=c2; 
for j=2 :mm 
for i=2:D-1 . 
Vb(i)=U(i-l,j-1)+U(i+l,j-1)+s2*U(i,j-1); 
end 
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X=trisys(Va,Vd,Vc,Vb) ; 
U(1:Dn,j)=X2; 

end 

U=U， 


了 Exercises for Parabolic Equations 
(人 | 
HE (3a) ”Verify by direct substitution that wx(x,t) = Sin(zrx)e 4m2r2r js a solution to the 
heat equation wxr (xc, 0 = 4Uxrx(x,T) for each positive integer7 一 1,2,.... 
(b) Verify by direct substitution that KU(x,D 一 Sin(nTX)e Cnr2r is a solution to 
the heat equation xy (x ,站 ) 一 c2xxx(c, 站 foreach positive integer = 1 2, ...， 
2 What diffGiculty might occur 放 Ar = 大 = 12/c2 is used with formula (7)? 
In Exercises 3 and 4, use the forward-difference method to calcujlate the first three rows of 
the approximate Solution for the given heat equation. Carry out your calculations by hand 
(calculatom). 
3. rt) = MUrxxi,for0<xryx<1land0< rr<01， withthe initial condition 
&Ux, 0) = 一 xz) 一 Sin(rx),fort 一 0and0<x<1,andthe boundary conditions 


(0,D=cl=0 forx=0and0<1<0.1， 
tl,I) 一 c2=0 forxy 一 land0<r<0.1. 


Let 屎 一 0.2, 上 三 0.02,andr 一 0.5. 


4. tx1) 三 Mrrhfor0<y<1liand0<<0.1 withthe initial condition 
UL, 0 = =1l 12r lforr=0and0<x<1]landthe boundary 
conditions 


LUL(0,1) 一 c1=0 forx=0and0</<0.1， 
tb 一 c2=0 forx= 王 land0<1<0.1. 


S. Suppose that At 一 大 二 12/(2c2). 
(a) Use this in formula (16) and simplify. 
() Express the equations in part (a) in the matrix form 4 无 = 号. 
(o 〇 Js the matrix in part (b) strictly diagonally dominant? Why? 
6.。Show that wx, 让 = 二 六 1 aje Wasin(jrxjis asolution to Br 有 一 rr 有， 


for0<xY<1and0<1andhastheboundary values x(0,1) 三 0,x(D = 0,and 
xx, 0) 一 并 /19j Sin(7TrX)， 


7. Consider the analytic solution wx(z ,站 一 sin(rx)e 了 2 十 sin(3rx)e (mr that was 
discussed in Example 10.4. 
(a) Hold x fxed and determine limi_ oo wx(x，D， 
(b) What does this mean physically? 
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8， Suppose that we wish to solve the parabolic equation xz (x, 旨 rr(x gt 一 疡 (x). 
(aj) Derive the explicit forward-difference equation forthis Situation. 
(b) Derive the implicit difference formula for this situation.， 
9. Suppose that equation (11) is used and that 太 (x) > 0, 81G0) = 0, and 82(0) 三 0. 
(a) Show that the maximum value of wx (xi +1) in row /十 1 is less than or equal 
to the maximum of wii, 国 ) inrow 
(pbD) Make a conjecture concerning the maximum of zc 加) inrowPmas1tendsto 
infinity. 


Algorithms and Programs 





In Problems 1 and 2, use Program 10.3 to solve the heat equation xi(x, 站 一 c2uxx(x，D， 
for0 <xY<1land0<f<01 withthe initial condition x(r,0) = ,forr =0and 
0<x<l',andtheboundary conditions 
U(0, 门 一 cl1=0 forx=0and0<!1<0.1， 
tl 站 一 c2=0 forxy= 一 land0<!<0.1， 
for the given values，Use the surf and contour commands to plot your approximate 
solutions. 
1， Use jx) = sin(rxY) 十 Sin(27x), 产 =0.1 大 =0.01,andr 一 1. 
2.Use jx)=3 |3x 113x 27=0.1 大 一 0.01andr = 1. 
3. (a) Modify Programs 10.2 and 10.3 to accept the boundary conditions wx(0, 六 一 
81() 关 0andu(a,D = 82(D 关 0. 
(b) Use your modified Program 10.3 to solve the heat equations in Problems 1 and 
2, but use the boundary conditions 
zt(0,D=8 一己 forxy=0and0<1<0.1， 
xl 一 82 人 一 ef forxy 一 land0<f<0.1 
in place of cl = c2 = 0. 
(c) Use the surf and contour commands to plot your approximate solutions. 


4. Construct programs to impiement your explicit forward-difierence equations and im- 
plicit difference formulia from parts (a) and (b) of Exercise 8, respectively. 


SUse your programs from Problem 4 to solve the heat equation ir (cx 四 xxr(x 门 二 
sin(xj,for0<xY<1and0<!<0.20, with the initial condition xxz, 0) = jx) 一 
sin(TX) 十 Sin(37x) and the boundary conditions 


xu(0, 门 一 c=0 forx=0and0<f<0.20， 
&(,I 站 三 cC2=0 forxy=1land0<ft<0.20. 


Let 瑚 一 0.2, 大 一 0.02,andr = 0.3. 
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Elliptic 卫 quations 


As examples of elliptic partial differential equations, we consider the Laplace, Poisson， 
and Helmholtz equations. Recall that the Laplacian of the function kx， y) is 


(]) V2z 一 xx 十 2yy- 


With this notation, we can write the Laplace, Poisson, and Helmholtz equations in the 
following forms: 


(2) V2x =0 Laplace'”s equation， 
(3) V27 一 SCxyy) Poisson's equation， 
(4) V2z 十 Jo yi 一 8Cy) Helmholtz's equation.， 


Itis often the case that the boundary values for the functions g and Jare known at al 
points on the sides of a rectangular region R in the plane. In this case, each of these 
equations can be solved by the numerical technique known as the finite-difference 
method. 


The Laplacian Difference Equation 
The Laplacian operator must be expressed in a discrete form suitable for numerical 
computations. The formula for approximating (xz) is obtained from 


jx+ 丫 200) 十 Fax 月 
天 2 


(5) Jr) = 十 D(0). 


When this is applied to the function x(x, y) to approximate Uxx(Cx, yy) and zyy(zy) 
and the resujlts are added, we obtain 


(6) V27 一 &Uc 十 瑚 ,7) 十 UC 天 ,y) 十 2 十 六 十 UP 有 4u(xz, 妇 
Assume that the rectangle 尺 = {(x,7) :0<xr<a0<y<b where pl/a =m/1] 
is subdivided into 吕 1x 天 Tsquares with side 天 (ie.,a 一 mpandp 一 710) as 
shown in Figure 10.14. 


To solve Laplace's equation, we impose the approximation 


&(X 十 关切 十 ULC 天 为 十 KGty 十 站 十 MUCy》 问 4u(r，y) 
RE 一 
which has order of accuracy O(22) at all interior grid points (kt, y) 一 Co, 》 门 for 
1 = 六 1andj 一 2 .Pi 1 Thegridpoints are uniformly spaced: 
AHL 二 天 十 放 和 1 一 下 用 JI 一 用 十 放 andy ll 二 天 Usingthe 
approximation xiyj for x(xi, yj equation (7) can be written in the form 


十 O(p2). 


(7) 0， 


(9) V2 AU 十 和 1 十 唔 /1 十 后 1 4 
7 ~ 一 /mn 一 


2 、 
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刀 7 Bigure 10.14 The grid used with 
”1 Laplace's difference equation. 





Higure 10.1S The Laplace stencil. 


which is known as the five-poiat GJererece jprmuia for Laplace's equation。This 
formu]a rejates the function value zj) to its four neighboring values zl， 六 有 1 
丰 /1， and zj) 1, as shown in Figure 10.15. The term 12 can be eliminated in (8) to 
obtain the Laplacian computational formula 


(9) HL 十 丰 17 十 不 H1 十 下 六 1 4 后 三 0. 


Setting Up the Linear System 
Assume that the values UK(x, y) are known at the following boundary grid points: 
MGxl yh 王 MU) for2<J<m 1 (onthelefo， 
xi yD) 一 大 1 for 2<z<7m 1 (on the bottom)， 
rm y 门 一 xj) for2<J<m 1 (ontherightb， 
Li yi) 一 zi for2<i<n 1 (on the top). 


Thben applying the Laplacian computational formula (9) at each of the interior points 
of R will create a linear System of (2) equations in (PP 2) unknowns, which is 
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Figure 10.16 ASx35gridtfor 
boundary values only. 





solved to obtain apProximations to kx， y) at the interior points of 只 For example， 
Suppose that the region is a Square, that 7 一 网 一 S$, and that the Unknown values of 
xi yj at the nine interior grid points are labeled pl1，P2,，...，po9 and positioned in 
the grid as shown in Figure 10.16. 

The Laplacian computational formaula (9) is applied at each of the interior grid 
points, and the result is the System 4 尼 一 了 of nine linear equations: 


4P1 十 P2 十 _P4 一 M2,1 1,2 
PlL 4p2 十 D3 十 25 一 13,1 
P2 4P3 | 十 _p6 一 141 45,2 
P1 4p4 十 P5 十 _P7 一 21.3 
D2 十 p4 405 十 16 十 _P8 =0 
P3 十 25 456 十 pe 三 05,3 
P4 42D7 十 PR 一 1U2.5 UL4 
PS 二 P7 4p8 十 pe= .535 
P6 十 8 4p9 王 145 15,4， 


Example 10.5、 Find an approximate solution to Laplace's equation V22 = 0 in the 
rectangle 及 = (Gy) :0<7Y<40<y<4 where xx,y)denotes the temperature at 
the point (x, y) and the boundary values are 


&Lx,0)=20 and xx,4)=180 for 0<7x<14， 
and 


x(0,yJ)=80 and x4,y7)=0 for 0<y<14. 
See Figure 10.17 forthe grid to be used. 
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12 5 二 180 ia,5= 180 14.5 二 180 


24.4=80 15,4=0 
4,3 三 80 5,3 二 
2,2 三 80 15.2=0 





Figure 10.17 The 5 xS grid in 


1=20 01=20 册 1=20 Example 10.5. 


Applying formula (9) in this case, the linear System 4 书 一 妨 is 


4P1 十 P2 十 _P4 = 100 
PI 4p2 十 P3 十 B5 = 20 
P2 4p3 十 _P6 = 20 
D1 4P4 十 5 十 _P7 = 一 80 
PD2 二 pP4 4p5 十 p6 十 Ps =0 
P3 十 p5 4p6 二 po 一 0 
P4 4P7 十 _P8 一 260 
2D5 十 p7 4pg 十 pe 一 180 
P6 十 pg 4po 三 180 


The solution vector 尼 can be obtained by Gaussian elimination (or more efficient 
Schemes can be devised, Such as the extension of the tridiagonal algorithm to pentadiagonal 
systems), The temperatures at the interior grid points are exXpressed in vector form 


P= 人 [pl PP pp 有志 p 有 ps p] 
= [55.7143 43.2143 27.1429 79.6429 70.0000 
45.3571 112.857 111.786 84.2857]/. 昌 


Derivative Boundary Conditions 


The Neumann boundary conditions specify the directional derivative of wx， y) normal 
to an edge. For our illustration we will use the zero normal derivative condition， 


0 
(10) 4， y) = 0. 
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42 一 4 由 
一 |,m 而 二 六 
睫 -11 全 +L1 
4 1 2 -1 
zj+1 细 oj+1l 
4 222,/ 2 1,) 4 
71 zj-1 


Figure 10.18 The Neumann stencils. 


For applications in the area of heat fow, this means that the edge is thermally insulated 
and the heat ftux throughout the edge is zero. 

Suppose that x 一 Xn is held fxed and that we are considering the right edgex 一 4 
of the rectangleR = {(x,y):0<x<a0<y < 用 .Thenormalboundary condition 
to be used along this edge js 


0 
(11) 区 om y1) 三 oo) 一 0 


Then the Laplace difference equation for the point (xn，y7) is 
(12) tn+lj 十 Mr 1 十 zaji+l 十 za 1 4) 一 0. 


The value xn+l,j) is unknown, because it lies outside the region R. However we can 
use the numerical differentiation formula 


n+ za 1 
(13) 于 


芒 xxzr(xz y 门 三 0 


and obtain the approximation un+1Lj) 色 zmr 1 六 Which has order of accuracy OP2)， 
When this approximation is used in (12), the result is 


2zn 1 十 tr/+LI 十 tn 1 4 三 0. 
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l2.5=180 19.5= 180 由 5=180 


45,4=0 
xs,3=0 
15,2=0 


=(0 
51 Rigure 10.19 The 5 x 5 grid i 
Example 10.6. 


This formula relates the fanction value xn， J to its three neighboring values Un 1， 六 
Un, jl and xn 1 

The computational stencils for the other edges can be derived similarly (see Fig- 
ure 10.18)，The four cases for the Neumann computational stencils are summarized 
DeXt: 


(14) 242 十 1 十 由 LU 4 一 0 (bottom edge)， 
(1 和 ) 2 十 丰 Tm 十 2 4 二 0 (top edge)， 
(10) 22,) 十 1 1 十 2i+L 4 一 0 (left edge)， 
(17) 2 1 十 xj) 1 十 zj+l 4 一 0 (right edge). 


Suppose that the derivative condition gx(x, y)/3N = 0 is used along part of the 
boundary of R, and that known boundary values of 4(x, >y) are used on the other por- 
tions of the boundary; then we have a mixed problem. The equations for determining 
approximations for (xi, y7) at boundary points wiinvolve appropriate Neumann 
computational stencils (14) to (17). The Lapliacian computationat formula (9) is still 
used to determine approximations for x(xi, yj) at the interior points of 尺 . 


Example 10.6， Find an approximate solution to Laplace's equation V24 = 0 in the 
Tectangle 尺 一 {(x, 妇 :0<x<40<y<4where xy) denotes the temperature at 
the point (x, y) and the boundary values are shown in Figure 10.19: 


wx,4) 一 180 for 0 <x < 4， 
xy(,0) 王 0 for 0 < <4， 
(0,y) 一 80 for 0< y < 4， 
zt(4,y) 一 0 for 0 < y < 4. 
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The Neumann computational formula (14) is applied at the boundary points g1，92， 
and 43, and the Laplace computational stencil (9) i8 applied at the other points 94，95， 
..，912. The result is a linear systetm 4@ = 下 involving 12 equations in 12 unknowns: 


491 十 92 十 294 一 80 
41 492 十 .43 十 295 =0 
42 493 十 246 一 0 

41 494 二 95 十 9 .= 一 80 
d2 十 944 495 十 96 十 48 一 0 
23 十 95 446 十 99 =0 

94 497 十 98 十 910 = 一 80 
95 十 917 49g+ 99 十 911 =0 
96 十 98 499 十 92 一 0 

97 4410 十 911 三 260 

ds8 十 910 4911 二 + 9q2 一 180 

99 二 9 4912 = 180 


The solution vector @ can be obtained by Gaussian elimination (or more efficient 
schemes can be devised, such as the extension of the tridiagonal algorithm to pentadiag- 
onal systems)，The temperatures at the interior grid points and along the lower edge are 
expressed in Vector form as 


CQ=[ggg4g49q4q69 980409192] 
= [71.8218 56.8543 32.2342 75.2165 61.6806 36.0412 


87.3636 78.6103 50.2502 115.628 11S.147 86.3492]/. 国 


Iterative Methods 


The preceding method showed how to solve Laplace's difference equation by con- 
structing a certain System of linear equations and solving 让 The shortcoming of this 
method is storage; each interior grid point introduces an equation to be solved. Since 
better approximations require a finer mesh grid, many equations might be needed. For 
example, the solution of Laplace'”s equation with the Dirichlet boundary conditions re- 
quires solving a system of (5 2)(m 2) equations. If Ris divided into a modest 
number of squares, say 10 by 10, there would be 91 equations involving 91 unknowns， 
Hence it is sensible to develop techniques that will reduce the amount of Storage. An 
iterative method would require only the storage of the 100 numerical approximations 
{ 纺 站 throughout the grid. 
Let us start with Laplace”s difference equation 


(18) Mi+L7 十 由 17 十 2 十 丰 ) 1 467 一 0 
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and suppose that the boundary values (xz, y) are known at the folowing grid points: 


My 门 王 xz) for2<J <Pm 1 (onthelefb， 
&(tiy yl1) 一 引 ii1 for 2<7<Pm 1 (on the bottom)， 
Unyyh 门 一 un for2<J<m 1 (ontherghb， 
MOxi yn) 一 由 im for2<i<7 1 (on the top). 


(19) 


Equation (18) is rewritten in the following form that is suitable for iteration: 
(20) 一 有 了 十 庆 放 
where 


Mi 十 下 1 十 下 ji 十 帮 1  424 
(28) njJ= 一 人 1 


for2<i<7m land2<] 攻 Pi |. 

Starting values for all interior grid points must be supplied. The constant 天 , which 
is the average of the 27 十 21 4boundary values given in (19), can be used for this 
purpose. One iteration consists of sweeping formula (20) throughout all of the interior 
points of the grid. Successive iterations Sweep the interior of the grid with the Laplace 
iterative operator (20) until the residual term 疡 ) on the right side of equation (20) is 
“Teduced to zero” (ie | 让) <eholdsforeach2 < <P 1and2</) 三 由 1 
The speed of convergence for reducing all the residuals { 记 ,to zero is increased by 


using the method called successive overrelaxation (SOR). The SOR method uses the 
iteration formujla 


雁 直 1 十 在 1 十 不 翔 1 十 奈 广 1 2 ) 
下 ij 一 由 ii 十 站 | 一 
(22) 人 4 
一 上 十 OO 让 让 
where the parameter wo lies in the rangel < ww < 2. In the SOR method, formula (22) 
is SwWept across the grid until | 六 , /| < e. The optimal choice for mw is based on the study 


of eigenvalues of iteration matrices for linear Systems and is given in this case by the 
formula 


2+ 4 (oo( 二 )+eos( 关 让 


lifthe Neumann boundary condition is specifed on some portion of the boundary， 
we must rewrite equations (14) through (17) in aform that is suitable for iteration, The 


(23) 0 一 


S46 ”CHAP. 10 SOLUTION OF PARTIAL DIFFERENTIAL EQUATIONS 


four cases are summarized next and include the relaxation parameter w: 


(24) t+e( 2 (bottom edge)， 
(25) 

W (2 (op edge)， 
(20) 

1 ( 因 : 十 ULj 1 二 -5 deftedge， 
(27) 

2 一 Us 十 外 ( 宕 入 1 十 n 二 1n,j 二 1 站 (right edge). 


了 上 xample 10.7， Use an iterative method to compute an approximate solution to Laplace's 
equation V2 一 0inR 一 {cy):0<x<40<y<4 wheretheboundary vaiues are 


U,OD=20 and ka:4)=180 for0<x<4， 
and 


0, y) = 一 80 and xx47) 三 0 for 0 < y < 4. 


Eor illustration, the square is divided into 64 Squares with Sides Ay 一 下 一 0. and 

Ay 三 疡 = 0.3. The initial value at the interior grid points was set at zj) 三 70 for 
eachi 一 2 .8andj 三 2 ...，8. The SOR method was used with the parameter 
wo 一 1.44646 (Substitutez 三 9andm 一 9informula(23)). After 19 iterations, the residual 
was uniformly reduced (ie., 人 六) 站 < 0.000606 < 0.001). The resulting approximations are 
given 训 Table 10.6. Because of the discontinuity of the boundary function at the corners， 
theboundary values 41,1 = 50,.x9,1 = 10,ul9 = 130, and yee = 90havebeenintroduced 
in Table 10.6 and Figure 10.20; they were not used in the computations at the interior grid 
points. A three-dimensional presentation of the data in Table 10.6 is given in Figure 10.20. 
四 


了 Example 10.8， Use an iterative method to compute an approximate solution to Laplace's 

equation V2x 一 0in 尺 一 { 人 人 :0<x< 4;0 <y < 4}, where the boundary values 
are 

U(x,4)= 三 180 for 

ty(x,0) 一 0 for 

tu(0,y) 一 80 for 

&U(4,7) 一 0 for 


and 0<7<4， 
and 0<x< 王 4， 


性 司 呈 下 


and 0<y<4， 


nm rr vi 
| 


and 0<y<4. 


FEor illustration, the square is divided into 64 squares with sides Ax 一 岂 = 0.5$ and 
4Ay = 六 = 0.5. Starting Yalues using linear interpolation were used along the edge where 
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Table 10.6 ”Approximate Solution to Laplace's Equation with Dirichlet Conditions 


93.9210 | 88.7553 
79.6515 | 76.3999 | 70.0003 
67.6241 | 62.0267 | 5353.2159 
55.5$159 | 48.8671 | 42.7568 
40.5195 | 35.1691 | 31.2899 
20.0000 | 20.0000 | 20.0000 





Figure 10.20 2 = xy) with Dirichlet boundary values. 


7》= 71 三 0.The initial value at the interior grid points was set at xj,) = 70 for each 
1 一 2,...,8andyj) =2,...,8. Thenthe SOR method was employed with the parameter 
0 一 1.44646 (as in Example 10.7). After 29 iterations, theresidual was uniformly reduced; 
(ie., | 关中 二 0.000998 < 0.001). The resulting approximations are given in Table 10.7. 
Because of the discontinuity of the boundary functions at the corners, the boundary vaiues 
19 一 130 and x9,9 = 90 have been introduced in Table 10.7 and Figure 10.21; they were 
not used in the computations at the interior grid points. A three-dimensional presentation 
of the data in Table 10.7 is given in Figure 10.21. 覃 
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Table 10.7 ”Approximate Solution to Laplace's Equation with Mixed Boundary Conditions 




















84.7247 
80.4424 
77.8354 
76.4244 
75.9774 


86.7936 
79.2089 
74.4742 
71.8842 
71.06005 


4 | 80.000 
好 | 80.000. 
闪 | 80.000 











55.7707 31.3032 





Figure 10.21 2 一 wy) foramixed problem， 


Poisson's and Helmholtzxs Equations 


Consider Poisson's equation 
(28) Vo=8gG,y). 


Using the notation 8i) 二 SO yj),the generalization of formula (20) for solving (28) 
over the rectangujlar grid js 


2iL1 十 丰 1 十 机, 十 下) 1 4 晤 28i 


(29) 7 一 所 ,7 十 才 
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Consider Helmholtz's equation 
(30) V + oo yu 8Cry)， 


Using the notation 户 ) = /ci yj),the generalization of formula(20) for solving (30) 
over the rectangular grid is 


UL 十 L 十 本 1 十 让 1 (4 色 记 站 由 8 


(31 有 三 居 十 4 有 2 万 )/ 


These formulas are explored in greater detail in the exercises. 


Improvements 


A modification of (8) that can be employed is the 1zze-poiat djfererzce Joratia for 
Laplace's equation: 
2 1! 
Vi 科 +1j 1 十 机 1 1 十 WUj+I 士 LiA1! 
十 4 十 46 1 十 4 十 4 1 2047)) 三 0. 


The truncation error for the nine-point difference formula is of the order O(p4) when 
it is used to solve the Poisson or Helmholtz equation; thus there is no improvement 计 
the nine-point difference formula is used instead of the five-point difference formula. 
However when the nine-point formula is used to solve Laplace's equation V24 = 0， 
the truncation error is of the order DO (HP6) and there is an advantage to using the nine- 
point difference formula. 


Program 10,4 (Dirichlet Method for Laplace's Equationm)， To approximate the 
Solution of Uxx(z, y) 十 yy y) =0over 尺 ={y):0<xz<a0<sy<pb 


with xc,0) = 帮 00 U0cD) = 户 pfor0<z<aandx0y)= 方 0)， 
ta,y) 一 (07),for0<y<P.Lisassumed thatAx = Ay 一 andthat integers 
1 and 7 eXist So that da = 77 and pb 三 1 六 





function U=dirich(ftl,f2,f3,f4,a,b,h,tol,maxl) 


%Input - fl,f2,f3,f4 are boundary functions input as StITings 
多 -~ a and b right end points of [0,a] and [0,b] 

六 - h step size 

儿 - tol is the tolerance 


YXDOutput - U solution matrix;i analogous to Table 10.6 
%IDnitialize Parameters and TU 

n=fix(a/h)+l; 

m=fix(b/h)+1l; 

ave=(ayk (feval(fl,0)+feval(f2,0)) ... 
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+by (feval(f3,0)+feval(f4,07))77(2*a+2xb) ; 
U=aveykones (n ,mm) ; 


X%Boundary conditions 
U(C1L,1:m)=fteval(f3,0:hb:(m-1)*h) ; 
Un,1l:m)=feval(f4,0:h:(m-t)*xh)，; 
U(t:n,1i)=feval(fl,0:h:(n-1)*h) ; 
U(C1:n,m)=feval(f2,0:h:(Cn-1)*hy) ; 
U(Ct,1)=(U(1,2)+U(2,1))7V2; 
U(1,m)=(U(1,m-1L)+U(2,m))7/2; 
U(Cn,1)=(U(Cn-l1,1)+UGn,2))72; 
Un,m)=(UCn-t,m)+UCn nm-1l))7V2; 
XSOR parameter 
w=4/ (2+sdrt(4-(cos(Pi/(n-1))+cos(Pi/(a-1)))>2)); 
XRefine approximations and sweep operator throughonut 
Xthe grid 
ez=1; 
CDt=0i 
while((err>tol) 友 (cnt<=maxl) ) 
err=0O; 
for j=2:m-1 
for 1i=2:0-1 
relx=vwy(U(i,j+l)+U(i,j-1i)+U(Ci+l,j)+U(i-i,j)-4*U(i,j))V4; 
U(i,j)=U(i,j)+relx; 
if (err<=abs (relx)) 
erI=abSs(relx) ; 
end 
end 
end 
、CDt=CcCnt+l 
end 


U=flipud(U:) ; 


Exercises for Elliptic Equations 


1，( 约 Determine the System of four equations in the fourunknowns p1, p2, p3, and 由 
forcomputing approximations forthe harmonic function wx(x, y) in the rectangle 


有 RR={cy):0<x<30<y<3l(seeFigure 10.22). The boundary values 
are 


HU, DO) 一 10， and xx,3)=90 for 0<x<3， 
t(0, 7 一 70 and xuGy=0 for 0<y<3. 
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UL3=70 


2 2 =70 


1 3 =70 


0 2=70 


1 =70 


(b) 
2. (3) 


() 
3、(9) 


(pb) 


!2.4= 90 ,4=90 


443=0 


M42=0 





Figure 10.22 


=10 1=10 The grid for Exercise 1 


x2,4=90 43,4= 90 


,3=0 


,2=0 


441=0 了 iigure 10.23 
The grid for Exercise 2 





Solve the equations in part (a) for pl1, p2，p3, and D4. 


Determine the system of Six equations in the Six unknowns 9g1, 42,，...， 946 for 
computing approximations for the harmonic function (xz, y) in the rectangle 


R={e,y):0<x<30<y<3](eeFigure 10.23). The boundary values 
are 


ut,3) 一 90 and xy 0)=90 for 0<x<3， 
lt(0,y) 一 70 and 2x3, 放 =0 for 0<y<3. 


Solve the equations in part (a) for gl1, 42,. ..，96. 
Show that xz, y) = alsin(x) sinh(y) 十 pl sinh(x)sin(y) is a solution of La- 
place's equation. 


Show that kw(xz, y) = an sin(nx) sinh(nay) 十 pn sinh(zx)sin(py) is a solution of 
Laplace's egquation for each positive integerm 一 1,2, .，.， 


4. Letux, 尹 一 妇 六 .Determinethe quantities lx 十 放 7),aCc 大 7) 2UC y 十 四， 
and xz, ,substitute them into equation (7), and simplify. 
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S。(3) 
(D) 


(o) 


(9) 


Eigure 10.24 
The grmid for Exercise 7 


Suppose that x has the form xx, y) = ax2 十 pxzy 十 cy2 二 dx 七 ey 十 上 Find 
arelationship among the coefficients which guarantees that wxx 十 xyy = 0. 
Suppose that x has the form given in part (a)，Find a relationship among the 
coefficients which guarantees that wkxx 十 wyy 一 1. 

Find the coefficients of the polynomial x(x, y) given in part (a) that satisfy 
the partial differential equation in part (a) and also the boundary conditions 
utx,0O) 一 0andv(x,p) 一 0， 

Find the coefficients of the polynomial x(x, y) given in part (a) that Satisfy 
the partial diffterential equation in part (b) and also the boundary conditions 
ULx,0O 一 0Oandkx,pB) 一 0 


6、Solve kxxz 十 Uyy 一 4UovVerR ={y):0<xz<10<y<1withtheboundary 
values 


&U(r, y) 一 cos(2x) 十 Sin(27). 


7.Determine the system of four equations in four unknowns P1，Pp2，P2，and Pp4 for 
implementing the Laplace nine-point difference equation on the 4 x 4 grid shown in 
Figure 10.24， 


Algorithms and Programs 





1 (3) 


(D) 


Use Program 10.4 to compnute approximations for the harmonic function Kx， y) 
in the rectangle 尺 = {(,y) :0<xy<130<y<15use 玉 三 0.$. The 
boundary values are 
uC,0) 一 xz4 and xc,1.5) 一 太 13.5z2 十 5.0625 for 0 <x <1.5， 
U(0,J) 一 只 and x(1.5, 放 = 王 六 13.$ 灶 十 $.0625 for 0 < y》 < 1.5. 


Use the surf command to plot your approximation from part (a) and compare 
it with the exact solution kz, y) 一 x4 6x2y2 十 好. 
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2. Modify Program 9.11 (TIridiagonal Systems) to solve a pentadiagonal system. 


3. (3) 


(b) 
(c) 
(d) 


(b) 
(c) 
(gd) 


6. (3) 


Useas xsSgrid similar to that in Example 10.9 and determine the system of 
nine equations in the nine Unknowns P1,Pp2，P3, ...，po9 for computing approx- 
imations for the harmonic function x(xz, y) in the rectangle 尺 = {(xz,y) :0 芭 
YX<4.0<y<4},Theboundary values are 


tx 0 一 10 and uk 三 120 for 0<7x<14， 
x(0,y) 一 90 and zx(4,y7) 一 40 for 0<y<4. 


Use your modification of Program 9.11 to solve for P1, pz, ...。 po9. 

Use Program 10.4 to Solve forthe approximations. 

Usea9x9gridsimilar to that in Example 10.7 and Program 10.4 to solve for 
the approximations. 


Useas x3 grid similar to that in Example 10.6 and determine the system of 
12 equations in the 12 unknowns gl1, 92, ...,912 for computing approximations 
for the harmonic function Kxz, y) in the rectangle 尺 二 {GCy) :0<x<4， 
0<y<4}.The boundary values are 


U,4) 一 120 and wyxy)=0 for 0<x 工 <4， 
U(0,y) 一 90 and ML47)=40 for 0<y7<4. 


Use your modification of Program 9.11 to solve for gl, qg2, . . .，912. 

Modify Program 10.4 to solve for the approximations，. 
Usea9x9grdsimilar to that in Example 10.8 and a modification of Pro- 
gram 10.4 to solve for the approximations. 

Usinga3 x35grid, derive the nine equations involving the nine unknowns pl1， 
D2,，p3, .po for computing approximations for the solution wx(r, y) to Pois- 
SOn's equation with 8(x, y) = 2 in the rectangle 尺 = {GCc 站 :0< 工 < |， 
0<y<].The boundary values are 


LO0) =x2 and MY, 1) = (x 1)? for 0<x<1 

rz, 人 = 六 and UL)=(O 1UD for 0<y<1， 
Use your modification of Program 9.11 to solve for P1,，P2,，. . .，Po9， 
Modify Program 10.4 to solve for the approximations， 
Usea9x9grdandyourmodification of Program 10.4 to solve for the approx- 
imations. 


Using as x 5 grid, derive the nine equations involving the nine unknowns P1， 
P2,，PD3, .……， po for computing approximations for the solution w(xz, y) to Pois- 
Son s equation with 8(C,y) = y in the Tectangle 尺 = {() :0<yY<1， 
0<y<1].The boundary values are 


xxr,O) =x3 and MX，1) =x3 for 0 <X 芭 
x(0,y) 三 0 and zx,7)= 三 1 for 0< 
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(b) Use your modification of Program 9.11 to solve for P1，P2，...，Po9. 
(cj) Modify Program 10.4 to solve for the approximations. 


(8 Usea9x9grid and your moditcation of Program 10.4 to solve for the approx- 
imations. 








Eigenvalues and 卫 igenvectors 


The design of certain engineering Systems involves the 7zaxizzz112 8S176S5 纺 eomy OF 
Jilture，、This theory is based on the assumption that the maximum principal stress 
acting on a body determines its failure. The related mathematical result is the principal 
axes 由 eorem for a linear transformation 了 一 4 瑟 ， In two dimensions there exists 
basis vectors UV1 and V2 so that the effect of this transformation js to stretch space in 
the directions parallel to 71 and 2 by the amount 入 1 and 和 2, respectively Consider 
the symmetric matrix 


3.8 0.61 
06 2.2|， 





3 0 3 6 9 12 -3 0 3 6 9 12 


gurell1 (a) Preimages ri = [3 1] and2=[ 1 3] for the transformation y = 4 大. (b) The 
lage vectors Y1 = 4UV1 = [12 4] andY2=4U2=[ 2 6] 


SSS 
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the principal directions are U1 = [3 寺 and V: = | 1 3], with corresponding 
eigenvalues 和 1 一 4 and 和 2 一 2， respectively，Images of these Vectors are， Vi1 一 
471=[l12 4 =498 Iandyz=4z=|[2 6]=2[1 3] .This 


transformation stretches the quarter-circle shown in Figure 11.1(a) into the quarter 
ellipse shown in Figure 11.11(b). 


Homogeneous Systems: The Eigenvalue Probliem 


Background 


We will now review Some ideas from linear algebra. Proofs of the theorems are either 
left as exercises or can be found in any standard text on linear algebra (See Refer- 
ence [132])7. 

In Chapter 3 we Saw how to solve mn linear equations in 7 unknowns、It was as- 
Sumed that the determinant of the matrix was nonzero and hence that the solution was 
unique，JIn the case of a homogeneous System 4 下 = 0, if det(4) 六 0, the unique 
solution is the trivial solution 天 = 0. If det(4) = 0, there exist nontrivial solutions to 
4 下 一 0. Suppose that det(4) = 0, and consider solutions to the homogeneous linear 
Systemn 


CI11X1 十 Cl2X2 十 .十 Clnxn 一 0 
CQ21X1 十 C22X2 十 … .十 02mxn 一 0 


(b 


anlXl 十 Qnr2x2 十 … 十 Qnrxn 一 (0. 
The system of equations (1) always has thetrivial solution xl 一 0,x2 = 0,. .xir 一 0. 


Gaussian elimination can be used to obtain a solution by forming a set of relationships 
between the variables. 


区 xample 11.1， Find the nontrivial solutions to the homogeneous System 


XI1 十 2x2 23 一 0 
271 十 22 十 妇 一 0 
Sxl 十 4x2 十 xX3 王 0. 


Use Gaussian elimination to eliminate xl and the result is 


X1 十 272 X3 王 0 
3x2z 十 3x3 王 0 
6x2 十 6x3 一 0. 
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Since the third equation is a multiple of the second equation, this system reduces to two 
equations in three unknowns: 


X1 十 X2 =0 
xX2 十 X3 一 0. 
We can select one Unknown and use it as a parameter,， For instance, let x3 一 then 


the second equation implies that x2 一 上 and the first equation is used to compute xl1 一 了 
Therefore, the solution can be expressed as the set of relations: 


X1 1 
X2 一 # or 不 一 1 | 一 1 | ， 
X3 开 ! 1 
Where 1 is any real numberT. 曾 


Deftinition 11.1 (Linear Independence). The vectors 0 D，，...，U are said to 
be Lieartgy jzdeperadertifthe equation 


(2) clU1i 十 czV2 十 …: 十 cr 一 0 


implies that cl = 0, c2 = 0, ...,cn 一 0. Ifthe vectors are not linearly independent 
they are Said to be linearly dependent. In other words, the vectors are Paearpy depen- 
det ifthere exists a set of numbers {cl, cz,. .., cn not all zero, such that equation (2) 
holds. 全 


Two vectors in %2 are linearly independent if and only if they are not parallel. 
Three vectors in %3 are linearly independent 计 and only if they do not lie in the same 
Plane. 


Theorem 11.1.、 The vectors 7 1, 772,...,Vn are linearly dependent ifand only ifat 
least one of them is a linear combination of the others， 


Adesirable feature for a vector space is the ability to express each vector as a linear 
combination of vectors chosen from a small subset of vectors. This motivates the next 
definition. 


Definition 11.2 (Basis)， Supposethaty = {1 2,...,Dnjisasetofm vectorsin 
3 The set S is called a basis for g%" 这 for every vector 无 in gm there exijsts a unique 
set of scalars {cl, c2,，, .cmj so that 下 can be expressed as the linear combination 


(3) 下 三 CIUIT 二 ca2 十 十 cnrzn 全 


ITheorem 11.2， Im %"，, any set of mn linearly independent vectors forms abasis of 9 
Each vector 在 in 只 "is uniquely expressed as a linear combination of the basjs vectors， 
as shown in equation (3)， 


-一 一 -一 -一 一 一 一 一 一 一 … 一 一 一 一 
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Theorem 11.3。 Let 开 1, 开 2，..., 开 mbe vectors in 只 7 


(4) 开 m > 7m,then the vectors are linearly independent. 
(9) 下 六 一 7,the vectors are linearly dependentifand only ifdet( 天 ) = 0， 
whbere 天 一 [Ri 天 2 .，， 开 m |] 


Eigenvyalues 


Applications of mathematics sometimes encounter the following equations: What are 
the Singularities of 4 和 X7 ，where 入 is a parameter? What is the behavior of the 
Sequence of Vectors {47 下 0]7207 What are the geometric features of a linear trans- 
formation2 Solutions for problems in many different disciplines, such as economics， 
engineering，and physics，can involve ideas related to these equations，The theory 
of eigenvalues and eigenvectors is powerful enough to help solve these otherwise in- 
tractable problems. 

Let 4 be asquare matrix of dimension mz x7and letX beavectorof dimension7m. 
The product 了 = 4X can be viewed as a linear transformation from m-dimensional 


Space into itself. We want to find scalars 入 for which there exists a nonzero vector 下 
Such that 


(0) 人 下 一 入 五 ; 


that is, the linear transformation 了 (天 ) = 4 下 maps 五 onto the multiple 和 瑟 ，When 
this occurs, we call 大 an eigenvector that corresponds to the eigenvalue 和 ,and together 
they form the eigenpair 和 , 互 for 4. In general, the scalar 和 and vector 下 can involve 
complex numbers，For simplicity, most of our ilustrations will involve real calcula- 
tions, However, the techniques are easily extended to the complex case. The identity 


Imatrix 7 can be used to express equation (6) as 4X 一 7 下, which is then rewritten in 
the standard form for a linear System as 


(7) (4 入 门 互 一 0. 


The significance of equation (7) is that the product of the matrix (4 和 7) and the 
nonZzero vector 大 is the zero vector! According to Theorem 3.5, this linear system has 
nontrivial solutions 让 and only if the matrix 4 和 7 is singular, that is， 


(8) det(4 和 X 门 一 0. 
This determinant can be written in the form 
al 和 人 ada2  … am 
C21 022 人 Q2n 


(9) : : : = 0. 


nl Cr2 on 入 
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When the determinant in (9) is expanded, it becomes a Polynomial of desree ,which 
js called the characteristic polynomial 


ao p(O = det(4 和 站 
=( D2?(02 二 cl I 二 co“ 十 .… 十 co 1 十 cn)， 


There exist exactly an roots (not necessarily distinct) of a polynomial of degree )7. 
Each root 入 can be Substituted into equation (7) to obtain an underdetermined System 
of equations that has a corresponding nontrivial solution vector 下. 入 和 is real, a real 
eligenvector 互 can be constructed, For emphasis, we state the following definitions. 


Definition 11.3 (Eigenvaiue)， 下 4is an7 xmnrealmatrix,then its mn eigenvalues 和 1， 
入 2,...，Xn are the real and complex roots of the characteristic polynomial 


(11) pOJ) = det(4 入 门 和 


Definition 11.4 (Eigenvectorm)。 If 和 Xis an eligenvalue of 4 and the nonzero vector T 
has the property that 


(12) 4Y = XV， 


then Y is called an eigenvector of 4 corresponding to the eigenvalue 入 . 从 


The characteristic polynomial (11) can be factored in the form 
(13) PUOJ 王 (1 XDA2) 2 (和 RD) 


where mmj called the multiplicity of the eigenvalue 入 j). The sum of the multiplicities 
of all eigenvalues is mi; that is， 


天 一 i1 十 玉 2 十 … 十 7 
The nextthree resujlts concern the existence of eigenvectors. 


Theorem 11.4. (a) For each distinct eigenvalue 入 there exists at least one eigenvec- 
tor Y _ corresponding to 入 . 

(b) 斑 has multiplicity r, then there exist at most r linearly independent eigenvec- 
tors 8 1 YY2，..，,Yyr that correspond to 入 ， 


Theorem 11.S.。 Suppose that 4 is a square matrix and 和 1, X2，...，XK are distinct 
eligenvalues of 4，with associated eigenvectors 1，VY2,，...，Yk， Tespectively; then 
{YlY2,...,Ykjis aset oflinearly independent vectors. 


Theorem 11.6. If the eigenvalues of the xz matrix 4 are all distinct, then there 
exjst mn eigenvectors VYj, for /= 1, 2,. .7. 
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Theorem 11.4 is usually applied for hand computations in the following manner. 
The eigenvalue 和 of multiplicityr > 1 is substituted into the equation 


〈14) (4 XIDY =(0. 


Then Gaussian elimination can be performed to obtain the Gauss reduced form, which 
will involve 7 大 equations in munknowns，whbere 1 < 大 < 上，Hence there arTe 大 
free variables to choose. The free variabjles can be Selected in a judicious manner to 
produce linearly Independent solution vectors Y 1 Y2，...，VYK that correspond to 人. 


Example 11.2。 Find the eigenpairs 和 j，Y) for the matrix 


3 ] 0 
4 一 1 2 1 
0 3 


Also, show that the eigenvectors are linearly independent. 
The characteristic equation det(4 和 站 一 0is 


(15) L 2 入 11= 和 )3+82 19+T12=0， 
0 1 3 入 


which can be written as (人 1)(A 3)( ， 4) 三 0.Therefore,the three eigenvalues are 
和 1 一 1 和 X2 一 3,and 和 3 三 4. 
Case (不 Substitute 和 1 = 1 into equation (14) and obtain 


2X1 2X2 一 0 
X1 十 2X2 X3 一 0 
X2 十 2X3 一 0. 


Since the sum of the first equation plus two times the second equation plus the third equa- 
ton is identically zero, the System can be reduced to two equations in three unknowns: 


2xXi 2 = 一 0 
X2 十 2X3 王 (0. 


Choose 妃 = 24, Where a is an arbitrary constant; then the first and second equations are 


used to compute xl 一 4 and x3 一 4 Iespectively.， Thus the first eigenpair is 和 一 1， 
YI 一 [ae 2a 2a] =afi 2 直 
Case ( 芭 :， Substitute 和 2 = 3 into equation (14) and obtain 


X2 一 0 
Xl X2 3 三 0 


X2 一 0. 
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This is equivalent to the System of two equations 
| 十 X3 一 0 
X2 一 0， 


Choose xl 一 , where pb is an arbitrary constant, and compute X3 一 pD. Hence the second 
cigenpairis) = 3,VY2=[0 =2o[I0 1]. 
Case (ii Substitute 和 3 一 4 into (14); the result is 
1 X2 = 一 0 
XlL 2xr? xxX3 一 0 


xX2 2X3 一 0. 
This is equivalent to the two equations 
X1 十 X2 一 0 
x2 十 X3 一 0. 
Choose x3 三 c, where c is a constant, then use the second equation to compnute x2 一 cc. 


Then use the first equation to get xl1 = CThus the third eigenpair is 和 3 王 4，VY35 一 
[c C c] 一 c[1 1 ] 

To prove that the vectors are linearly independent, it suffices to apply Theorem 11.5. 
However it is beneficial to review techniques from linear algebra and use Theorem 11.3. 
Form the determinant 


CQ P 


尼 
det [Vi TY: VY3])= 24 0 c| = 6cpc. 
人 忆 C 


Since det [VY1 VY2 VY3]) 二 0, Theorem 11.3 implies that the vectors Y1, V2, and V3 are 
linearly independent. 四 


Example 11.2 shows how hand computations are used to find eigenvalues when 
the dimension mn is small: (1) fnd the coefficients of the characteristic polynomial; 
(2) find its roots; (3) find the nonzero solutions of the homogeneous linear System 
(4 AT)Y 三 0. We will take the prevalent approach of studying the power and Jacobi 
methods and the CR algorithm. The CR algorithm and its improvements are used in 
professional software packages such as EISPACK and MATLAB ([178]). 

Since Y in (12) is multiplied on the right side of the matrix 4, it is called amzg1t 
eligenipector corresponding to 和 . There also exists a left eigenvector 了 such that 


(16) 7Y'4 = 入 7Y/. 


In general, the left eigenvector 了 is not equal to the right eligenvector Y . However， 
让 4 is real and symmetric (4 = 4), then 
(4VY) =V4 = YA4， 


47) (AY) = 入 V/ 
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Therefore, the right eigenvector Y ls a left eigenvector when 4 is symmetric. In the 
remainder of the book we consider only right eigenvectors. 

An eigenvector Y is unique only up to a constant Imujtiple. Suppose that c is a 
Scalar; then the following calculation shows that cyY is an eigenvector: 


(18) 4(cVY) =c(4Y) = c(Y) 一 入 (cCY). 


To regain some Semblance of uniqueness, we normalize the eigenvector in one of 
the following ways. Use one of the vector norms 


(19) 中 le = max {x 
1 < 天 < 


OF 


1/2 
(20) 1X12 = 可 be 
大 一 1 


and require that either |。 = 1or| 开 2 = 1 


Diagonalizability 


The eligenvalue situation is easiest to understand for a diagonal matrix 刀 that has the 
form 


1 0 .0 
0 )X2 .… 0 
(2D) 已 = diag( 和 1, 入 2， .xn) 一 。 . 
0 0 ，… 和 


Let 五 ) 三 [0 0 和 01 0.……: 0] be the standard base vector， whbere the j th 
component is 1 and all other components are 0. Then 


(22) 万 忆 ;= [0 0 .… 0 和 0.… 0] = 和 ) 瑟 )， 
which implies that the eigenpairs of D are 入 ) 无 j fory = 1 2,...,7.Itis desirable 
to invent a Simple way of transforming the matrix 4 into diagonal form so that the 
eigenvalues are left invariant. This is the motivation for the following definition. 


Defnition 11.S。， Twow x mn matrices 4 and 了 are said to be similar if there exists a 
nonsingular matrix 枣 So that 


(23) 盏 一 玉 14 天， 和 


Theorem 11.7. Suppose that 4 and 刀 are similar matrices and that 和 is an eigen- 
value of 4 with corresponding eigenvector Y. Then 入 is also an eigenvalue of 妃 . 开 


玉 14 天 一 玉 ,theny = 天 1Y is aneigenvector of 及 associated with the eigen- 
value 入 ， 
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An7xPmatrx 4is caled diagomalizapie if it is similar to a diagonal matrix. 
The next theorem illuminates the intimate role of eligenvectors in this process. 


Theorem 11.8 (Diagonajlization). The matrix 4 is similar to a diagonal matrix 妃 让 
and only 让 it has m linearly independent eigenvectors. I 4 is similar to D,then 


Y 147==diag(Cl,)2,...,X) 


(24) 
V =[V: Y> ..， Vn|， 
where the mn eigenpairs are 人) 记 了 hj for 7 一 12， ,7， 


Theorem 11.8 implies that every matrix 4 that has mn distinct eigenvalues is diago- 
nalizable. 


了 xample 11.3， Show that the following matrix is diagonalizable. 


3 1 0 
4 王 1 2 1 
0 1 3 


In Example 11.2 we found the eigenvalues 和 1 = 1 X2 三 3, and 3 一 4 and the matrix 
of eigenvectors 


Y=[y yz Va]= 


二 下 一 
心 
一 


The inverse matrix y 1is 


吃 
一 
| 
La 一 II 一品 | 一 
ul NI 一 ON 


Itis left to the reader to check the details in computing the product in (24): 


1 1 1 
5 3 8 1 0 1 1 1 1 0 0 
二 0 1 2 1|=|2 0 II=|0300 
1 41 141Lo 1 1 1 1 0 0 4 
3 3 3 


Hence we have shown tbhat 4 can be diagonalizedi; thatis, Y_ 14VY = 万 一 diag(1,3,4).@ 


A more general resujlt relating the structure of a matrix to its eigenvalues is the 
following theorem， 


TIheorem 11.9 (Schur。 Suppose that 4 is an arbitrary ” x 7 matrix. A nonsingular 
Imatrix 严 exists with the property that 了 = 忆 14 忆 , where 7 is an upper-triangular 
matrix Whose diagonal entries consist of the eigenvalues of 4. 
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Certain types of structural analysis in engineering requjre that a basis of Ji be 
selected that consists of the eigenvectors of 4，This choice makes it easier to visu- 
alize how space is transformed by the mapping 了 = 了 (X) 一 4 下 .Recall that the 
eigenpair 入 j， 站 has the property that 7 maps Yy onto the multiple of 入 ) Y)，This 
characteristic is exploited in the following theorem. 


Theorem 11.10. Suppose that 4 is an7 xj matrix that possesses 7 linearly inde- 
pendent eigenpairs 入 )， Yi) for ] = 1, 2, ... ,mithen any Vector 大 in 9 has aunique 
representation as a linear combination of the eigenvectors: 


(25) 疏 一 CIY1 十 c2VY2 十 … 十 coyVn. 

The linear transformation 了 ( 互 ) = 4 厂 maps 大 onto the vector 

(20) 了 三 7(X) =cCIAIY1 十 c2X28Y2 十 -… 十 cnAnWn 

辽 xample 11.4. Suppose that the 3 x 3 matrix 4 has eigenvalues )1 一 2, 和 2 一 |， 


and )3 = 4, which correspond to the eigenvectors Yl1 = [12 2 .Yv=[21 吉 
and VY3 = [1 3 4] ,respectively. 开 瑟 = [ 1 2 ]],fhind the image of X under the 
mapping 了 () 一 4 三 . 
We must first express 于 as a jinear combination of the eigenvectors. This is accom- 
plished by solving the equation 
[12H=cfl2 +c[f 21I+cf3 4 
for cl, c2, and c3. Observe that this is equivalent to solving the linear system 


cl 2cz 二 c3= 1 
2C1 十 C2 十 3c3 三 2 
2cl1 十 c? 4c3 = 1. 
The solution is cl = 2, c2 = 1, and c3 = 1， Using Deftinition 11.4, for eigenvectors， 
了 ( 于 ) is found by the computation 
了 (X) 一 4(2Y1 十 Y2 YY3) 
一 24VY1+A4Y?7 4V73 
一 2(2YU) YY 4V83 
=[2 5 7 了. 和 


Virtues of Symmetry 


There is no easy way to determine how many Jinearly independent eigenvectors a ma- 
trix possesses without resorting to using the most effective algorithms in a professional 
software package such as EISPACK or MATLAB. However it is known that a real 
symmetric matrix has 7 real eigenvectors and that for each eigenvalue of mnultiplic- 
ity 1aj there coOrTesponds mi linearly independent eligenvectors, Hence every real sym- 
metric matrix is diagonalizable， 
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Definition 11.6 (Orthogonal).  A set of vectors {Y1，Y2，...，Ynj is said to be 
orthogonal provided that 


(27) VE 一 0 whenever 了 天 大 人 么 


_Definition 11.7 (OrthonormalD.。 Suppose that {tY 1 Y2,. .Yaojisasetof orthog- 
onal vectors; then we Say that they are orthonormal if they are al of unit norm, that 
isS， 


(28) ViVkE=0 whenever 了 关上 
太太 =1 tor al ] = 1，2，...， 几 . 生 


Theorem 11.11. An orthonormal set of vectors is linearly independent， 


Rermark. The zero vector cannot belong to an orthonormal set of vectors. 


Definition 11.8 (Orthogonal Matrix)， An 关 xmmatrx 4is said to be orthogonal 
provided that 4'is the inverse of 4; that is， 


(29) 44= 了 站 
which is equivalent to 
(30) 4 = 4 


Also, 4 is orthogonal if and only if the columns (and rows) of 4 form a set of or- 
thonormal vectors. 全 


Theorem 11.12， I 4 is a real symmetric matrix, there exists an orthogonal matrix 改 
Such that 


(31 开 '4 开 一 开 14 天 二 也 ， 
where D is a diagonal matrix consisting of the eigenvalues of 4. 


Corollary 11.1， I4is an7z xmrealsymmetric matrix, there exist mn linearly inde- 
pendent eigenvectors for 4, and they form an orthogonal set. 


Corollary 11.2， The eigenvalues of a real symmetric matrix are all real numbers. 


_Theorem 11.13. Eigenvectors corresponding to distinct eigenvalues of a symmetric 
matrix are Orthogonal. 


Theorem 11.14， A symmetric matrix 4 is positive definite 让 and only if all the 
eigenvalues of 4 are positive. 
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了 stimates for the Size of Eigenvalues 


It is useful to fnd a bound for the magnitude of the eigenvalues of 4. The following 
Tesults will give some insights. . 


Definition 11.9 (Matrix Norm). Let | 七 上 be a vector norm. Then a_ corresponding 
natural mmatrix norm is 


| 4 于 | 


32 41 = max 1 一 |. 
(2) | 4 | [可 


For the norm | 41。 the following formula holds: 


旭 
33 入 一 |， 。 委 
(33) 141。 JR 人 加 


Theorem 11.1S$，、 If 和 is any eigenvalue of 4, then 
G34) | < 1 4 ， 


for any natural matrix norm | 41. 


Theorem 11.16 (Gerschgorin's Circle Theorem)， Assumethat 4 is an xm matrix， 
and let Cj denote the disk in the complex plane with center ajj and radius 


(35) 六 一 y、 lei for each /一 1，2，...，17i 
k=1K7 
that is, Cj consists of all complex numbers z 一 x 十 iy such that 
(30) Ci={z:z as 
开 49 三 和) Ci, then all the eigenvalues of 4 lie in the set S$. Moreover the union of 


anyK of these disks that do not intersect the remaining 7 。 大 must contain precisely 大 
(counting multiplicities) of the eigenvalues， 


Theorem 11.17 (Spectral Radius Theorem)， Let 4 be a sSymmetric matrix，The 
Spectral radius of 4 is 41l2 and obeys the relationship 


G37) 14l2 = max{lx1l, | 和 2|，. .|Xnl}. 
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An Overview of Methods 


For probliems involving moderate-sized symmetric matrices, it is safe to use Jacobi's 
method，EFor problems involving large Symmetric mmatrices (for ma up to several hun- 
dredj, it is best to use Householder's method to produce a tridiagonal form, followed 
by the CR algorithm. Unlike real symmetric matrices, real unsymmetric matrices can 
have complex eigenvalues and eigenvectors. 

For matrices that possess a dominant eigenvalue, the power method can be used 
to find the dominant eigenvector. Defiation techniques can be used thereafter to find 
the first few subdominant eligenvectors. For real unsymmetric matrices, Householder's 
method is used to produce a Hessenberg matrix, followed by the ZR or CRalgorithm. 


卫 xercises for Homogeneous Systems: The Eigenvalue Problem 


革 、For each of the following matrices fnd (iD the characteristic polynomial p(), (iD the 
eigenvalues, and (iii) an eigenvector for each eigenvalue. 


1 2 1 6 2 3 
(a) 4=|， 2 (D) 4=|， :| (aq 4=| 3 | 
，a 1 1 
(D) 4=| .01 2 @ 4=|013， 
13 2 
0 004 


2。PDetermine the spectral radius of each of the matrices in Exercise 1 . 


3，Determine the | 412 and 44。 norms of each of the matrices in Exercise 1. 


Determine which, if any, of the matrices in Exercise 1 are diagonalizable. For each 
diagonalizable matrix in Exercise 1, fnd the matrices Y and 万 from Theorem 11.8 
and carry out the matrix product in (24)、 


S. (a) For any fxed 0, show that 


cos0 _ Sing 
R=| Sing 包 9| 


is an orthogonal matrix. 
了 Remarxk. The matrix 丸 is calljed a rotation matrix， 
(b) “Determine all values of 0 for which all the eigenvalues of 尺 are real. 


6.m Section 3.2 the Plane rotations 丸 z(o), 民 y(8)， and 慌 -(7) were introduced. 
(a) For any fixed aw, 8, and y, show that 尽 :(o), 尺 ,(6)，and 民 : (0 )，respectively， 
are orthogonal matrices. 
(Determine all values of w，p, and 7 for which ail the eigenvalues of 尺 .(o)， 
民 y(8), and 民 :(Y) ,respectively, are real， 


S68 CHAP. 11 EIGENVALUES AND EIGENVECTORS 


7. ret4=| 了 | 


2 C | 

(a) Show that the characteristic polynomial is P( 和 X) 王 入 z (3 二 20) 和 +a2 3a 4. 
(b) Show that the eigenvalues of 4 are 和 1 一 Ca 十 4and)X2 一 a 1 

(@) Show that the eigenvectors of 4 are Yl = [2 ]] andY2=[ 1 2] 


8，Assume that 入 , Y_ form an eigenpair of the matrix 4. 节 K is a positive integer, prove 
that )k, Y are an eigenpair of the matrix 4 


9， Suppose that Y is an eigenvector of 4 that corresponds to the eigenvalue 入 = 3. 
Prove that 和 = 9 is an eigenvalue of the matrix 42 corresponding to 了 


10. Suppose that Y is an eigenvector of 4 that corresponds to the eigenvalue 入 一 2. 
Prove that 和 一 is an eigenvalue of the matrix 4 1 Corresponding to Y. 
11，Suppose that 中 is an eigenvector of 4 that corresponds to the eigenvalue 入 一 和. 


Prove that 人 和 王 4is an eigenvalue of the matrix 4 7 corresponding to Y. 


12. Let 4 be an7 xx7 square matrix with characteristic polynomial p(X) given by 
P(X) = det(4 1) 
=( 1 十 cb 十 c2 如 “二 十 cn 内 十 cm) 


(a) Show that the constantterm of p(X) is cr 一 ( TD2det(4)， 
(Show that the coefficientof 和 2 Lisci 三 (ail 十 ds 十 十 Cn) 


13.。Assume that 4 is similar to a diagonal matrix; that is 
TY 147Y = 万 = diag(M1, 和 2 7)， 
IK is a positive integer, prove that 


4 外 一 Ydiag( 做 ,和 DY 1 


Power Method 


We now describe the power method for computing the dominant eigenpair Its exten- 
sion to the inverse power method is practical for finding any eigenvalue provided that a 
good initial approximation is known. Some schemes for finding eigenvalues use other 
methods that converge fast, but have limited precision. The inverse power method is 
then invoked to refine the numerical values and gain full precision，To discuss the 
Situation， we will need the following definitions， 


Definition 11.10， 开 和 iis an eigenvalue of 4 that is larger in absolute value than any 
other eigenvalue,it is called the domzizzant etgertyalue. An eigenvector Yi correspond- 
ing to 和 1 is called a domaizzarzt eigertpector. 全 
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Definition 11.11. An eigenvector Y_ js said to be normalized if the coordinate of 
largest magnitude is equal to unity (i.e., the largest coordinate in the vector Y_ is the 


number 1). 全 
It is easy to normalize an eigenvector [wa UV2 ... oj] by forming a new Vector 
TY 一 (l/c)[u U2 ... un] ， wherec 一 Uj and ui 三 maxl<i<zfluij. 


Suppose that the matrix 4 has a dominant eigenvalue 入 and that there is a unique 
normalized eigenvector Y that corresponds to 和 . This eigenpair 和 , Y_ can be found by 
the following iterative procedure called the power maetljiod. Start with the vector 


(D Xo=[L1.… 本- 
Generate the sequence { 和 4 recursively, using 


了 一 4 天， 


(2) 1 
下 人 +1 三 一 一 了 
CK 二 1 


Where ck+l is the coordinate of Yk of largest magnitude (in the case of a tie，choose 
the coordinate that comes first), The sequences { 忆 大] and {fckj will converge to Y and 
入, resSpectively: - 


(3) lm 2 一 了 and lim ck = 一人， 
天 -全 Oo 类 一 Co 
， 玉 ermark. If Xis an eligenvector and X0 夭 了, then some other starting vector must be 


chosen， 


Example 11.sS， Use the power method to find the dominant eigenvalue and eigenvector 
for the matrix 


0 11 5 
4 一 | 2 17 7 
4 26 10 


Start with Ko = [1 1 ]] and use the formulas in (2) to generate the sequence of 
vectors { 下 丰 ] and constants {ck]. The first iteration produces 


0 11 5||1 6 和 
2 17 7 11(=| 8|=12 一 C1 下 1. 
4 26 10|11 12 

The second iteration produces 
0 1l1 5|[ 好 1 喜 
2 1I7 7|13|=| 好 = 本 和 | = czX2. 
4 26 10|11 其 1 


-一 一 一 一 一 一 一 
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Table 11.1 Power Method Used in Example 11.5 to Find the Normalized Dominant 
Eigenvector Y 一 [# 弛 可 and Corresponding Eigenvalue 和 三 4 








4XK 一 了 三 Ck 二 大 1 

480 = [6.000000 8.000000 12.00000]' = 12.00000[0.500000 “0.666667 1] = Cl 天 1 
4 丰 1 = [2.333333 ”3.333333 ”5$.333333]' = 5.333333[0.437500 “0.625000 1] = C2 居 2? 
4X2 = [1.87S000 2.750000 4.500000]' = 4.500000[0.416667 0.611111 1 = C3 天 3 
4X3 = [1.722222 2.5$$$5$6 ”4.222222]′ = 4.222222[0.407895 0.605263 1]/ 一 C44 
4X4 = [1.65789$ 2.473684 4.105263] = 4.105263[0.403846 ”0.602564 1]' = CS 大 5 
4X5 一 [1.628205 2.43$897 4.051282]' = 4.051282[0.401899 ”0.601266 1 一 5C6 天 6 
4X6 = [1.613924 2.417722 4.025316]' = 4.025316[0.400943 “0.600629 1 = CT 在 7 
4X7 = [1.606918 2.408805 4.012579]'′ = 4.012579[0.400470 “0.600313 1 = C8 下 8 
4X8 = [1.603448 2.404389 ”4.006270] ”= 4.00627050.400235 “0.600156 ]]' 三 C99 
4X9 = [1.601721 2.402191 4.003130]′ = 4.003130[0.400117 “0.600078 1]' = C10 厦 10 
4X10 = [1.600860 2.401095 4.001564]' = 4.001564[0.40005$9 “0.600039 1] = cl11 瑟 11 





Tteration generates the sequence { 天 (where Xis a normalized vecton): 


】 了 忆 31 2 127 
看 节 元 妈 315 
12|2| 5 2382 到 | 王 | 1835| 
3 |， 3 8 1， 2 18 |， 9 38 1， 19 78 1 39 198 | ， 
1 了 工 1 1 


The sequence of vectors converges to Y 一 [# 引 二， and the sequence of constants 


converges to 和 三 4 (see Jable 11.1).、 It can be proved that the rate of Convergence is 
linear 和 


Theorem 11.18 (Power Method). Assume that the mn x 7 matrix 4 has mn distinct 
eigenvalues 和 1, 2, ...，, 和 mr and that they are ordered in decreasing magnitude; that is， 
(4) |A1| > |A2| |A3| 之 二 人 | 


开光 0 is chosen appropriately, then the sequences { 一 [zx xz) ..，x09] ] and 
{ck] generated recursively by 


(9) 了 一 4 
and 
1 
(0) 星 k+1 一 一 一 了 kb， 
CA 十 1 
whbere 


(7) cx and x= Inax {lxz 人 的 | 
二 开 
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will converge to the dominant eigenvector Y1 and eigenvalue 入 1, respectively. That is， 
(8) ， lim XXX 一 Yl and lm cx 一 入 1. 
天 一 OO 大 一 co 


Proof Since 4 has 7 eigenvalues, there are 1 corresponding eigenvectors 了 ji for 
j 一 1 2,...,7m, that are linearly independent normalized，and form a basis for )- 
dimensional space, Hence the starting vector 天 0 can be exXpressed as the linear combi- 
nation 


(9) X0 王 PIY1 十 p2V2 十 … 十 加 Yn. 
Assume that 不 0 一 [2 X2 ..。 xz] was chosen in Such a manner that p1 夭 0. Also， 
assume that the coordinates of 怀 0 are Scaled so that maxl1<j<nflxz 诈 = 1. Because 


{Y 用 ij-1 are eigenvectors of 4, the multiplication 4 天 0o, followed by normajization， 
produces 


70 = 4X0 王 4(DIYI 二 pp2Y2 十 … 十 DryYi) 
一 DI4VY1I 二 p24VY2 十 … 十 轨 AVYn 
(10) 一 DIXIY1I 十 po2X2VY2 十 .…: 十 PAY 


和 入 
一 和 (ari+o( 刀 ) VY2z 十 … 十 杞 ( 关 ) 小， 
人 1 和 1 


and 


AfterK iterations we arrive at 


(11) 
ZK 1 一 4XK 1 
欠 1 和 ANk 1 ) NE 1 
一 pIV1I 二 思 1 一 y 刀 | 之 Y 
clc2 人 1 :( 守 ) 2 , (总 ) ” 
入 1 ANAA 1 和 ANK 1 
= 一 一 -一 一 [54VY1I+ 轧 () 4V2 十 … 十 久 ( 疡 ) 4T， 
Cl1C2 CCK 1 入 1 入 1 
外 1 和 ANK 1 和 ANE 1 
1 2 严 
一 一 一 | 21X1Y Bo2 | 一 入 > 及 四 一 
0 [人 1Y 1 十 :( 世 ) 27Y 2 十 +a( 和 】 和 rn 
天 人 天 入 天 
= 一 一 一 ori+( 世 ) 7z+…+ 姑 (总 ) y， | ， 
ClC2 ck 1 A1 和 1 
and 
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Since we assumed that 信用 /人 1 < 1for each yj 一 2.3,，. .1 Wehave 
和 
(12) lim 忆 ) () Vi =0 each 了 一 2， 3， 
大 一 oo 人 1 


Hence it foljlows that 
大 


CI 
(13) im XU = lim 一 一 一 一 
K 一 oo C1C2 . CK 


Wehave requiredthat both Xk and yl benormalized and their largest component be 1. 
Hence the limiting vector on the left side of (13) will be normajlized、with its largest 
component being 1. Consequently, the limit of the scalar multiple of Y1 on the right 
Side of (13) exists and its value must be 1; that is， 


， 7 
(14) nm 一 一 一 一 一 | 
K 一 cc C1C2 .CR 


Therefore, the sequence of vectors { 下 K} converges to the dominant eigenvector: 
(15) lm 居 一 站 1 

大 一 OO 
Replacing 大 with 上 1 intheterms ofthe sequence in (14) yields 


记 入 ! 1 
类 一 Do CiC2 CCK 1 ， 


and dividing both sides of this result into (14) yields 


六 大 。.， 
im 和 刀 - lim tcl co  - 工 一 1 


K 一 oo CE 大 ->oo DA 1/(clc2 ck 1 1 


Therefore, the Sequence of constants {ctj converges to the dominant eigenvalue: 


(10) lim cx 一 入 1， 
人 一 oo 
andthe proof of the theorem is complete. ，@ 


Speed of Convergence 


In the light of equation (12) we see that the coefficient of 了 ) iD 大 fgoes to zero 
proportion to (入 / AD and that the Speed of convergence of { kj to Yis governed 
by the terms (2 入 1) Consequently, the rate of convergence is linear. Similarly, the 
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Table 11.2 “Comparison of the Rate of Convergence of the Power Method and Acceleration of 
the Power Method Using Aitken's A2 Technique 


CKY 京 八 天 

clX1 一 12.000000[0.$000000 0.6666667 1]; 4.3809524[0.4062500 0.6041667 1]' = 合 胞 1 
c2X2 一 5$,3333333[0.437S000 0.62S0000 1]/; 4.0833333[0,401$152 0.6010101 1]' = C2 尖 2 
c3X3 一 4.3000000[0.4166667 0.6111111 1]'; 4.0202020[0.4003759 0.6002506 1]' = 包 X3 
c4 五 4 三 4.2222222[0.4078947 0.6052632 了 “; 4.0050125[0.4000938 0.6000625 1]' = 饭 苞 4 

C5 于 5 一 4.1052632[0.4038462 0.6025641 ]'; 4.0012508[0.4000234 0.6000156 1 = 全 X5 
c6X6 =4.0512821[0.4018987 0.6012658 1]; 4.0003125[0.4000059 0.6000039 1 = 全 党 6 
c7 下 7 “一 4.0253165[0.4009434 0.6006289 1]'; 4.0000781[0.4000015 0.6000010 1]'= 人 名 X7 
c8X8 一 4.0125786[0.4004702 0.6003135 1]'; 4.0000195[0.4000004 0.6000002 1 = 名 X8 
co9 夺 9 三 4.0062696[0.4002347 0.6001$65 1]/; 4.0000049[0.4000001 0.6000001 IT = 念 2 
c10 互 10 一 4.0031299[0.4001173 0.6000782 HH ; 4.0000012[0.4000000 0.6000000 1 = GoX10 


Convergence of the sequence of constants {fckj to 和 1 is linear The Aitken A2 method 
can be used for any linearly conyergent Sequence {Pkj to form a new sequence 


全 (pkH Pi 
2DK 一 -一 人 人 ”vv 外 
PK+2 2Pk+1 十 PK 
that converges faster In Example 11.4 this Aitken A? method can be applied to speed 
up convergence of the sequence of constants {ckj, as well as the firsttwo components of 


the sequence of vectors { 天 丰 , A comparison of the results obtained with this technique 
and the original Sequences is shown in Table 11.2. 


Shifted-inverse Power Method 


We will now discuss the Shifted inverse power method，It requires a good starting 
approximation for an eigenvalue, and then iteration is used to obtain a precise Solution. 
Other procedures such as the OAM and Given's method are used first to obtain the 
starting approximations， Cases involving complex eigenvalues, multiple eigenvalues， 
orthe presence of two eigenvalues with the same magnitude or approximately the same 
magnitude, will cause computational di 值 culties and require more advanced methods. 
Our illustrations will focus on the case where the eigenvalues are distinct. The shifted 
inverse power method is based on the foliowing three results (the proofs are left as 
eXerciseSs). 


Theorem 11.19 (Shifting Eigenvalues), Suppose thbat 人, Y is an eigenpair of 4. 下 
a is any constant, then 入 waw,Y is an eigenpair ofthe matrix 4  a7. 


Theorem 11.20 (Inverse Eigenvalues)， Suppose that 和 , Y_ is an eigenpair of 4. If 
入 尖 0,then 1/),Y is an eigenpair of the matrix 4 1 
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Figure 11.2 The location of a for the shifted-inverse 
Power method. 


Theorem 11.21. Suppose that 和 ,YY is an eigenpairof 4. 玉 w 关 入 ,then1( 和 oa) 了 
is an eigenpair of the matrix (4 wa7) 1. 


Theorem 11.22 (Shifted-inyerse Power Method). Assume that the 关 x matrix 


4 has distinct eigenvalues 入 1, 入 2, .….，Xn and consider the eigenvalue 入 j Then a 
constant Qw Can be chosen so that HAI = 1/() oa) is the dominant eigenvalue of 
(4 a1) 1 Furthermore, if Xo is chosen appropriately, then the sequences { 下 大 盖 
区 折 2 人 ..， 5 名 ] and {ckj are generated recursively by 
(17) 了 =(4 ao7 DT 
and 
1 
(13) 下 ki+1 = 一 一 六 
CK 十 1 
where 
(19) ctH1 一 zx) and zx 一 maxflzt) 
1<7 < 


wiil converge to the dominant eigenpair Ki, Y) of the matrix (4，、a7) 1. Finally, the 
corresponding eigenvalue for the matrix 4 is given by the calculation 


1 
(20) 和 ij 二 一 十 Q. 
凡 1 
Remark. For practical implementations of Theorem 11.22,a linear System solver js 
Used to compute 7 in each step by solving the linear system (4 wa 丰 7 一 瑟 K. 


Prpof Without loss of generality，we may assume that 和 1 < )2 < .……. < 入 。 Se- 
lect a number wa (Q 和 人 j) thatis closer to 入 ) than any of the other eigenvalues (see 
Figure 11.2), that is， 


(21) IAA cl<lIXM al for each 三 1 2 .17+1，...，7. 


According to Theorem 11.21，1/(OJ oa)，Y is an eigenpair of the matrix 
(4 wew 站 ) 1I，Relation (21) implies that 1/IN ol < LI alforeachi 关 基 
so that AL = 1/() oh) is the dominant eigenvalue of the matrix (4 aoa7) 1. The 
Shifted-inverse power method uses a modification of the power method to determine 
the eigenpair /1I，Y 7 ，Then the calculation 入 ) = 1/NAI 十 w produces the desired 
eligenvalue of the matrix 4. @ 
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Table 11.3 ”Shifted-inverse Power Method for the Matrix (4 ”4.27) 1 in 


Example 11.6: Convergence to the Figenvector Y 一 [# 弛 !] andHp1i 一 和 








(4 wa 六 工 夭 一 CK 二 1 下 +1 

(4 oa 站 1X0 = 23.18181818 [0.4117647059 0.6078431373 1] = cl1X1 
(4 ao 站 1 天 1 一 “5.336506239 [0.4009983361 0.6006655574 1 = c2X2 
(4 ca 有 ) 1 2 一 ”5$.030252609 [0.4000902120 ”0.6000601413 1] = c3X3 
(4 a 站 1 一 ”5.002733697 [0.4000081966 0.6000054644 1 = cd4X4 
(4 ao 站 1X4 一 ”5.000248382 [0.4000007451 “0.6000004967 1 = c5X5 
(4 wa 站 1X5 一，5.000022579 [0.4000000677 0.6000000452 117 = c6X6 
(4 oa 丰 1X6 一 “5$.000002053 [0.4000000062 ”0.6000000041 1] = c7 导 7 
(4 co 人 ) 1X7 = 一“$.000000187 [0.4000000006 0.6000000004 1 = cgXg 
(4 aoaT1) 1 于 8 一 ”3.000000017 [0.4000000001 0.6000000000 1 = co9Xo 


Example 11.6、 Employ the shifted-inverse power method to fnd the eigenpairs of the 
matriX 


0 11 9 
入 三 2 17 了 
4 26 10 


Use the fact that the eigenvalues of 4 are 和 1 = 4, 和 2 王 2, and 和 3 一 1, and select an 
appropriate oa and Starting Vector for each case， 


Case (让 FEor the eigenvalue 和 1 三 4，we select wa = 4.2 and the starting vector 
晨 0 一 [1 1 ]]- First form the matrix 4 4.27, compnute the solution to 
4.2 11 $ 


2 128 7 |7ro=xo= 
4 26 14.2 


and get the vector Yo = | 9.545454545 ”14.09090909 ”23.18181818] ， Then com- 
putecl = 23.18181818 and 天 1 三 [0.4117647059 0.6078431373 ] 吉 - Tteration gener- 
ates the values given in Table 11.3. The sequence {ckl convergesto HI 一 SS, which is the 
dominant eigenvalue of (4 4.2 门 Land { 和 converges to 71 一 冯 


value 和 1of 4is given by the compnutation 和 1 一 1/I+w = 1/( 5) 十 4. 
4 


1] .Theeigen- 
一 0.2 十 4.2 一 


《| 
huuw 


Case ( 动 : For the eigenvalue 和 2 一 2, we select w 二 2.1 and the Starting Vector 
晨 0 王 [ ]]- Form the matrix 4 2.17,compute the solution to 


2.1 1]1 | | 
2 14.9 7 |17o=Xo 三 | 1|， 
4 .26 12.1 1 


and obtain the vector 7Y0 一 11.05263158 21.37894737 42.63157895] . Then cl = 
42.63157895 and vector 天 1 = [0.25392592593 0.5061728395 1] . lteration produces the 
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Table 11.4 ”Shifted-inverse Power Method for the Matrix (4 2.17) 1in 
Example 11.6: Convergence to the Dominant Figenvector 了 = [1 二 直 and 
AL 一 10 

(4 am 1XK = Ck 二 1 大 KE 二 1 

(4  a 站 ) 1X0 = 42.63157895 [0.2592592593 0.5061728395 1] = cl1X1 
(4 a 门 1 开 1 = 9.350227420 [0.2494788047 ”0.4996$25365 1]' = c2 于 2 
(4 a 站 1 瑟 2 = 10.036S7511 [0.2S00273314 0.$000182209 1 C3 天 3 
(4 aD) 1 天 3 一 9.998082009 [0.249998S612 ”0.4999990408 1] C4 下 4 
(4 oa1) 1 下 4 一 10.00010097 [0.2S00000757 0.5000000505 ]/ C5 丰 5 
(4 a 门 工 筷 5 一 ”9.999994686 [0.2499999960 0.4999999973  / C6 居 6 
(4 oa 站 1X6 一“10.00000028 [0.2S00000002 0.5000000001 1 C7 下 7 





Table 11.S ”Shifted-inverse Power Method for the Matrix (4 0.875 门 Lin 


Example 11.6: Convergence to the Dominant Figenvector 了 = [二 才 1I] and 
MI 一 8 

(4 am 1XK 一 ck 二 1 古 E1 

(4  a7) 1X0 = 30.40000000 [0.5052631579 0.4947368421 1]' = CI 大 1 
(4 a1) 181 = 8.404210526 [0.5002004008 ”0.4997995992 1] = cz， 
(4 a) 1 于 2 一 8.015390782 [0.S000080006 0.4999919994 1 C3 下 3 
(4 a7) 1 天 3 = 8.000614449 [0.3000003200 0.4999996800 1 C4 基 4 
(4 aca 站 1 于 4 一 8.000024576 [0.5000000128 ”0.4999999872 1 C5 避 5 
(4 ac 站 1 天 5 一 8.000000983 [0.3000000005 0.4999999995 1] c6 导 6 
(4 aca 站 ) 1 于 6 一 “8.000000039 [0.5000000000 “0.5000000000 1 = CI 下 7 

values given in Table 11.4. The dominanteigenvalueof (4 2.17) lisH = 10,andthe 





eigenpair of the matix 4isX2 = IC ID0+21= 01+21=2andyz=[! 和 吉 - 

Case ( 衣 ) For the eigenvalue 和 3 三 1, we select a 一 0.875 and the starting vector 

Xo = [0 1 1]] .Iteration produces the values given in Table 11.5, The dominant eigen- 

valueof (4 0.8751) 1is 4 = 8, andthe eigenpair of matrix 4 is 和 3 = 1/8 十 0.875 一 

0.125 二 0.875 = 1 and Vs = [ 寺 二 可 .The sequence {Xkj of vectors with the starting 
， 。 。 -。 。 

Vector [0 1] converged in seven jiterations， (Computational diffculties were encoun- 


tered when Xo = [1 1 1] was used, and convergence took significantly longer) 国 








Program 11.1 (Power Method). To compnute the dominant eigenvalue 和 1 and its 
associated eijgenyectorY1 forthe7 xmatrix 4. His assumedthatthe mn eigenvalues 
have the dominance property | 和 1| > |X2| > |]X3| 二 … 二 | 和 > 0. 


function [lambda,V]=powerl(A,X,epsilon,max1) 
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%Input -Ais an nxn matrixX 
攻 -Xis the DXxl starting Vector 
久 - epsilon is the tolerance 
久 - max1 is the maximumn Dumber of iterations 
AhOutput -~ 1ambda is the dominant eigenvalue 
名 -~-V is the dominant eigenvectoTr 
%Initialize Parameters 
ambda=0; 
Cnt=O ; 
erI=T; 
State=l| ; 
while 〈(cnt<=max1)&(state==1)) 
Y=Ax* 芭 ; 


YNormalize Y 

钾 j] =max(abs(Y)) ; 

c1=m; 

dc=abs(lambda-cl) ; 

Y=(1/ct)*#*Y; 

hUpdate X and Lambda and check for convVvergence 

dv=norm(X-Y) ; 

err=max(dc,dv) ; 

X=Y; 

1ambda=cl; 

state=0; 

if (err>epsilon) 
State=1; 

end 

Cnt=cnt+l ; 


end 
V=X; 









Program 11.2 (Shifted-inverse Power Method)， To compnute the dominant eigen- 
value 人 j and its associated eligenvector Y j forthez xm matrix 4. lt is assumed that 
the 7 eigenvalues have the property 1 < 2 <…. < Xmandthat a is arealnumber 
such that | 入) al <|IX al,foreachi =12...， 7 17 二 1...,7. 





function [lambda,V]=invpow(A,X,alpha,epsilon,max1) 


%IDnput - A is an Dxmn matTixX 

欠 -Xis the nxl starting vector 

久 - alpha is the giVen Shift 

包 - epsilon is the tolerance 

包 - maxt is the maxjimum Dumber of iterations 


%DOutput -~ lambda is the dominant eigenvalue 
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为 -V is the dominant eigenvector 


%Initialize the matrix A-alphaI and Parameters 
[na za]=size(A) ; 

A=A-alphakeye(n) ; 

Tambdqa=0 ; 

Cnt=O ; 

erT=1 ; 

State=1 ; 


while 〈《(cnt<=maxt)& (state==t)) 
%MSolve System AY=X 
Y=ANX; 
YXNormalize Y 
器 j]=max(abs (Y) ) ; 
Cl=m; 
dc=abs(1ambda-c1) ; 
Y=(1/cl)*Y; 


khUpdate X and lambda and check for ConVeTrgence 


dv=norm(X-Y) ; 
erIr=max(dc ,dv) ; 
X=Y ; 
ambda=ctl; 
state=0O; 
if (err>epsilon) 
State=1; 
end 
Cnt=Cnt+l ; 
end 
1ambda=alpha+1/cl; 
V=X; 


Exercises for Power Method 


1. Let 和 , Y be an eigenpair of 4. Ifa is any constant, show that 和 ，a, Yisan eigenpair 


of the matrx 4 a7. 


2.， Let 和 ,Y be an eigenpair of 4. If 和 头 0, show that 1/, Y is an eigenpair of the 


matrix 4 1 


3. Let ), Y be an eigenpair of 4. If a 头 入 , show that 1/( 
the matrix (4 a 站 1. 


ca Y is an eigenpair of 


4.， Defation technigues，Suppose that 和 1, 2, 和 3，.. .和 are the eigenvalues of 4 with 
asSsociated eigenvectors Y1，Y2，VY3, ...，VYn and that 和 1 has Imultiplicity 1. 下 天 is 
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any vector with the property that 瑟 'Y1 一 1, prove that the matrix 
五 王 4 和 YI 


has eigenvalues 0, 入 ,入 3，...，Xn With associated eligenvectors 1 厂 2， 丽 3，...， 厂 ，， 
where YY and 于) are related by the equation 


Vi =( 人 和 和 全 ) 十 和 (Wi)YI for each /=2，3，...，7. 


S.， Markov processes and eigenvalues，A Markov process can be described by a square 
matrix 4 whose entries are all posltive and the column sums all equal 1，For illus- 
tation, let Po = [zy(O] record the number of people in a certain city who use 
brands X and 了 , respectively. Each month people decide to keep using the same brand 
or Switch brands. The probability that auser of brand X will switch to brand 了 is 0.3. 
The probability that a user of brand Y will switch to brand X is 0.2， The transition 
Imatrix for this process ls 


0.8 0.3] [zw) 
二 和 一 [2 0 区 


Hf4Pi) = Pi forsome /then 忆 三 Yissaidtobethesteady-state distribution 

for the Markov ProcesS. Thus, ithere is a Steady-state distribution, then 入 一 1 must 

be an eigenvalue of 4. Additionajlly, the steady-state distribution Y is an eigenvector 

associated with 和 三 1 (i.e.,solve (4 1 门 Y =10). 

(a) ”For the example given above; verify that 入 一 1 is an eigenvalue of the transition 
matrix 入. 

(b) Verify that the set of eigenvectors associated with 和 一 1 is Li[372 二 : 1 E 
只 ,上 上头 0)]， 

(c) Assume that the Population of the city was 50,000， Use your results from 
part (b) to verify that the steady-state distribution is [30,000 20,000] 


Algorithms and Programs 
LT | 
In Problems 1l through 4 use: 


(3a) Program 11.1 to find the dominant eigenpair of the given matrices. 
(b) Program 11.2 to find the other eigenpairs. 


7 6 3 14 30 4 
1L4=-| D 20 24|. 2.4=| 24 4 66|. 
6 1 16 12 24 32 
25 25 30 05 25 20 25 05 
| oo 50 20 2.0 | 05 50 25 05 
3 4=| 05 05 40 25| 44=| 15 10 35 25 
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Suppose that the probability that a user of brand X will switch to brandyY or Z is 0.4 
and 0.2, respectively. The probability that a user of brand 了 will switch to brand X 
or Z is 0.2 and 0.2, respectively. The probability that a user of brand Z will switch to 
brand X or y is 0.1 and 0.1, respectively. The transition matrix for this process is 


0.4 02 0.11 fxzg 
Pt 一 4P 一 |04 06 01117y0 
0.2 02 0.8| | zx 


(a) Verify that 和 = 1is aneigenvalue of 4. 
(D) Determine the steady-state distribution for a population of 80,000. 


Suppose that the coffee industry consists of five brands B1，B2，53, B4, and 妃 5. As- 
sume that each customer purchases a 3-pound can of coffee each month and 60 mil- 
lion pounds of coffee is sold each month. Regardless of brand, each pound of coffee 
Tepresents a profit of one dollar. The coffee industry has empirically determined the 
following transition matrix 4 for monthly coffee sales, where aij represents the prob- 


ability that a customer will purchase brand 玉 ; given that their previous purchase was 
brand 已 ) 


4=|10.1 03 0.4 0 02 


An advertising agency guarantees the manufacturer of brand Bi that, for $40 million 
ayear, they can change the first column of 4 to [0.3 0.1 0.1 0.2 0.3] . Should the 
manufacturer of brand Bl hire the advertising agency? 


。Write a program, based on the deflation technique in Exercise 4, to fnd all the eigen- 


values of a given matrix. Your program should call Program 11.1 as a subroutine to 
determine the dominant eigenvalue and eigenvector at each iteration. 


。 Use your Program from Problem 7 to find all the eigenvalues of the following matri- 


Ces. 
1 2 1 
(a) 4= | 1 0 1 
4 4 5S 
1 十 了 工 =7/ ， ， 
(b) 4= [cailwhereai = 一 1 ”andij = 1 2,...,15. 
贡 了 关 ) 
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Jacobi's Method 


Jacobi's method is an easily understood algorithm for fnding all eigenpairs for a sym- 
metric matrix. It is a reliable method that produces uniformly accurate answers forthe 
resujlts. For matrices of order up to 10, the algorithm is competitive with more Sophis- 
ticated ones. If speed is not a major consideration, it is quite acceptable for matrices 
up to order 20. 

A soiution is guaranteed for all real symmetric matrices when Jacobi's method is 
used，This limitation is not severe since many Practical problems of applied math- 
ematics and engineering involve symmetric matrices，From a theoretical viewpoint， 
the method embodies techniques that are found in more sophisticated algorithms， For 
instructive purposes, it is worthwhile to investigate the details of Jacobi's method. 


Plane Rotations 


We start with some geometrical background about coordinate transformations. Let 下 
denote a vector in mn-dimensional space and consider the linear transformation 了 一 
民 下 , where 尺 is an xPmmatrix: 


1 ... 0 ，，， 0 .0 
0 …， cos 几 .Sinbg … 0|erowp 
及 一 | : : 
0 ，…， Sin 由 .cos 由 …， 01c 一 rowg 
0 0 0 1 
个 个 
col P colq 


Here all off-diagonal elements of 尺 are zero except for the values 士 sin bg, and all 


diagonal elements are 1] except for cos . The effect of the transformation 了 一 民 球 is 
easy to grasp: 


?7 一 2 when j) 和 关 P and / 夭 9， 
yp 一 Ypcos 几 十 xzogsSinb， 
ye = xpsmnb 十 xocos. 


The transformation is seen to be a rotation of -dimensional space in the x pXa-plane 
through the angle g. By selecting an appropriate angle 办 we could make either yp 三 0 
or =0inthe image. The inverse transformation 不 一 尺 17 rotates space in the 


Same Ypxq-plane through the angle 9. Observe that Ris an orthogonal matrix; that 
js， 


RLI=-R or RR=T 
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Similarity and Orthogonal Transformations 
Consider the eligenproblem 


(4 4 于 一 入 于. 
Suppose that 玉 is a nonsingular matrix and that 及 is defined by 
(2) 巨 一 天 14 天， 


Multiply both members of (2) on the right side by the quantity 玉石 , This produces 
甩 天 ! 大 一 玉 14 天 天 1 一 开 14 下 
一 玫 内 下 一 入 民居 
We define the change of variable 


(4 了 = 玉 ! 玉 or 瑟 = 天 了 


G) 


When (4) is used in (3), the new eigenproblem is 
(5) 巨 了 王 人 了. 


Comparing (1) and ($)，we see that the similarity transformation (2) preserved the 
eigenvalue 和 and that the eigenvectors are different, but are felated by the change of 
variable in (4). 


Suppose that the matrix 届 is an orthogonal matrix (i.e., 尺 工 一 尺 ) and that Dis 
defined by 
(9) 万 一 尺 4 尺 . 
Multiply both terms in (6) on the right by 民 ' 天 to obtain 
(7) 万 尺 下 一 民 '4 民 尼 下 一 玉 4 于 一 玉 人 下 一 入 玉 ' 焉 . 
We define the change of variable 
(8) 7Y 一 RX or =R7. 
Now use (8) in (7) to obtain a new eigenproblem， 
(9) D7 = 和 了. 


As before, the eigenvalues of (1) and (9) are the same. However for equation (9) the 
change of variable (8) makes it easier to convert 下 tp 了 and 了 back into 厌 because 
及 1 一 民 '. 

In addition, suppose that 4 is asSymmetric mnatrix (ie 4 = 4 ). Then we findthat 
(10) 及 =(R4R) = 尽 4(R) 一 RAR 一 靖 . 


Hence isasymmetric matrix. Therefore, we concludethatif 4 is asymmetric matrix 
and 只 js an orthogonal matrix the transformation of 4 to 刀 given by (6) preserves 
syImmetry as well as eigenvalues, The relationship between their eigenvectors is given 
by the change of varfiable (8). 
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Jacobi Series of Transformations 


Start with the real symmetric matrix 4.，Then construct the sequence of orthogona 
matrices 民 1, 民 2，..， 尺 ， as follows: 


有 0 一 和 
〈1D) / ， 
忆 ) = 民 ) 记 / 1 恨 for 了 = 1， 2， 


We will show how to construct the sequence { 尺 站 so that 


(12) lim 吃 ) 一 妃 =diag( 和 人 1, 和 2，,..， 入 1). 


Jj 一 co 


JIn practice we will stop when the off-diagonal elements are close to zero. Then we wi 
have 


(13) ,之 也 . 


The construction produces 


(14) 万 ,一 尺 / 滞 : 本 1 14RIR2.… 尺 。 1 及 )，. 
Ifwe define 
〈15) 及 三 只 有 尺 2… 玉 。，1 民 ，， 


then 及 14 灵 一 万 , which implies that 
(16) 4 尺 三 开刀 一 屎 diag( 和 1, 入 2，... ,和 Xn). 


Let the columns of 丸 be denoted by the vectors 瑟 1, 天 7， .. ,在 ，Then 尺 can be 
expressed as a TOw vector of column vectors: 


(17) 及 = [1 2 ... 瑟 n]， 
The columns of the products in (16) now take on the form 
(18) [4 4X2? .…， 4Kn] = [11 )2 下 .和 mn 瑟 no]， 


From (17) and (18) we see that the vector 不 )，which is the jth column of R, is an 
eigenvector that corresponds to the eigenvalue 和 1 
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General Step 


Each step in the Jacobi iteration will accomplish the limited objective of reduction of 
the two off-diagonal elements 4pa and aap to zero. Let 尺 1 denote the first orthogonal 
Imatrix used. Suppose that 

(19) D1 = 玉 14 有 1 


Teduces the elements apd and aop to zero, where 只 has the form 


1 0 0 0 
0 C 3 0| 和 二 rowP 
(20) 及 1 一 : 
0 3 C 01|1< 熏 row 
0 0 0 1 
个 个 
colP Cold 


Here all off-diagonal elements of 玉 1 are zero except for the element y located in 
row P, column 9 and the element 8 located in row qg, column P、Also note that al 
diagonal elements are 1 except for the element c, whbich appears at two locations, in 
Tow P column p, and in ToOwW 9，column 9. The matrix is a plane rotation where we 
bhave used the notation c = cos 四 ands = Sin. 

We mnust verify that the transformation (19) w 记 produce a change only to rows 
andqg and columns P and 9g. Consider postmultiplication of 4 by 丸 1 and the product 
呈 一 4RRi: 


(21) 
211 Ql1p Cld Ci 1 0 0 0 
万 一 Gpl …， Gpp … pg … Qin 0 尼 8 0 
、 041 … 60qp …， CCqgg …， agon 0 8 C 人 
Cazl anp Gng arp 0 0 0 1 


The row by column rule for multiplication applies，and we observe that there is no 


changeto columns lto PP landp+ltod 1l1andg+lton.Henceonly columns 
anddq are altered， 


已 让 一 G 关 when 大头 PP and 大 关 d， 
(22) bjp 三 Cajp SGjd fory 一 1 2 ,. .7， 
pja 三 Sajp 十 cajg for 7 三 二 2 . .7 
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A similar argument shows that premultiplication of 4 by 丸 1 w 刘 only alter rows 忆 
and 9qg. Therefore, the transformation 


(23) D1 = R14 玉 1 


will alter only columns 忆 and qg and rows Pand qg of 4. The elements djik of D1 are 
computed with the formulas 


dp 一 Cjp 381g When ] 关 P and /和 0， 

d1g 三 Sajp 十 cQjg when 三 夭 P and /) 关 9， 
(24) dpp 一 c app 十? aqg 2csapa， 

dad = “app 十 czaoa 十 2csapa， 


2 
dpa 一 (c2 国 )apa 十 csS(app Qaa)， 


and the other elements of Di are found by symmetry. 


Zeroing out dp and dvp 


The goal for each step of Jacobi's iteration is to make the two off-diagonal elements 
dpe and dop zero. The obvious strategy would be to observe the fact that 


(25) C=cos 邮 and 8 一 Sin0b， 


where 由 isthe angle of rotation that produces the desired effect. However some inge- 
nious maneuvers with trigonometric identities are now Tequired. The identity for cot 
is used with (2S) to define 


C2 2 


(20) 0 = cot20 一 





2cy 


Suppose that apdg 夭 0 and we want to produce dp 一 0 Then using the last 
equation in (24), we obtain 


(27) 0= (c” ss)apg 二 cs(app aqq). 


This can be rearrangedto yield (c2 2) /(cs) = (aog app)/apg, Which is used in (20) 
to solve for 0: 


(28) 0 一 4&ed 4pp 
2apg 
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Although we can use (28) with formulas (2$) and (26) to compute c and s，less 
round-otfft error ls prfopagated 让 we comnpute tan bg and use it in latetr compnutations. So 
we define 


(29) f 一 tand 一 


局 到 


Now divide the numerator and denominatorin (26) by c2 to obtain 


1 8$2/c2 1 


2s/c ”2 
which yields tbe equation 
G0) 六 十 219 工 =0. 


Since ! = tanb, the Smaller root of (30) corresponds to the smaller angle of rotation 
with |0| < 立 /4. The special form of the quadratic formujla for fnding this root is 


ON 
31 一 8 土 (0 D)U2 -Sign 
7 《人 


Where sign(0) = 1 wbhenb > 0 and sign(0) = 1whenb < 0. Thencands are 
computed with the formulas 


1 
0G32) (TU 


一 Cf 


Summary of the General Step 


We can now outline the calculations required to zero out the element dpg. First select 
row 北 and column 9 for which aprd 关 0. Second, form the preliminary quantities 


他 亿 
6=42 《pp 
2apg 
加 Sign(O) 
G3) +(92 十 DU2 
1 
“二 五 二 TD72， 
3 一 Cf. 


3 
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Third, to construct 妨 = Di,use 
dp 一 0; 
aap = 0; 
dop =c “ 2csapq; 
PP 二 CQpp 十 9 qqg “<C34pqg; 


2 。 
dod 三 Sapp 十 c“ aa 十 2CSapai 


for 了 =1:N 
G4) 让 (~= 门 and (~=g) 
dp 三 cajp sqjgi 
doj 二 djpi 
dja 三 cqja 十 30jpi 
doj 一直 5; 
end 
end 


Updating the Matrix of Eigenvectors 


We need to keep track of the matrix product 只 1 尽 2 …. 尺 i。、 When we stop at the nm 大 
iteration, we will have computed 


(353) 一 民 1 民 2 民 ，， 


Where Yis an orthogonal matrix. We need only keep track of the current matrix 太 ， 
for / = 1 2,...,7m. Start by initializing Y = 7. Use the vector variables XP and XQ 
to store columns P and 4 of 4, respectively. Then for each step perform the calculation 


for /=1:N 
XE7 一 UPi 
XQ) 一 114; 
end 


36 
69) for 了 =1:N 


jp 一 CXPJ 3XQ): 
UJ4g 三 3 有 PP) 十 CXQ)i; 
end 
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Strategy for Eliminating wpy 


The speed of convergence of Jacobi's method is seen by considering the sum of the 
squares of the off-diagonal elements: 


开 
G7) SI = 2 oj 
jk=1 
kzx7 
天 
(38) 92 一 >， 1 where “也 | = 及 '4 尽 . 
ke1 
大 7 


The reader can Verify that the equations given in (34) can be used to prove that 
(39) 9 一 5S1 2lapo 上 六 


At each step we let 9j denote the sum of the squares of the off-diagonal eljements 
of 刀 ). Then the sequence {Sj decreases mmonotonically and is bounded below by zero. 
Jacobis original algorithm of 1846 selected, at each step, the off-diagonal element ap 
of largest magnitude to zero out and involved a search to compute the value 


(40) max{4)} 三 max{lapz|}. 
P<d 


This choice will guarantee that {S) converges to zero. As.a consequence, this proves 
that { 刀 jconveiges to 刀 and {Y /converges to the matrix W of eigenvectors (see 
Reference [68]). 

Jacobi's search can become time consuming since itrequires an order of (22 7 四 /2 
comparisons in a loop. It is prohibitive for larger values of 2. A better strategy is the 
cycjic Jacobi method, where one annihilates elements in a strict order across the rows， 
Atolerance value e is selected; then a sweep is made throughout the matrix and, if an 
element apqg is found to be larger than e, it is zeroed out， For one swWeep through the 
Imatrix the elements are checked in row 1,.al2, al3,...，,alnithen TIow 2, a23,a24，,..， 
42p; and So on. I has been Proved that the convergence rate is quadratic for both the 
original and cycjic Jacobi methods，An implementation of the cyclic Jacobi method 
starts by observing that the sum of the squares of the diagonal elements increases with 
each iteration; that js, 丰 


殉 
(41) 了 = >》 lej 站 
J=1 


and 


天 
聊 二 3 
j=1 
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then 

嫉 一 70 十 2lapg 有 
Consequently, the sequence { 忆 1) converges to the diagonal matrix 妃 . Notice that the 
average Size of a diagonal element can be computed with the formula (Tb/m)LI2. The 


magnitudes of the off-diagonal elements are compared to <c(70/1DU2, where ec is the 
Preassigned tolerance. Therefore, the element apy is zeroed out 让 


7 17/2 
(42) |apa|l > e 克 。 


Another variation of the method, called the threshold Jacobi method, is left for the 
reader to investigate (see Reference [178]). 


Example 11.7。 Use Jacobi iteration to transform the following symmetric matrix into 
diagonal form. 


8 13 1 
1 62 0 
3 29 1 
1 01 7 


The computational details are left for the reader The first rotation matrix that will zero 
out al13 一 3 is 


0.763020 ”0.000000 0.646375 0.000000 
0.000000 ”0.000000 0.000000 “0.000000 
0.646375 ”0.000000 0.763020 0.000000 上 | 
0.000000 “0.000000 “0.000000 “0.000000 


Calculation reveals that 4 一 RI4IRIis 


5.458619 ”2.055770 ”0.000000 ”1.409395 
2.0553770 ”6.000000 ”0.879665 0.000000 
0.000000 “0.879665 11.S41381 ”0.116645 
1.409395 ”0.000000 ”0.116645 7.000000 


Next the element al12 三 2.055770 is zeroed out and we get 


3.653$795 ”0.000000 ”0.579997 “1.059649 
0.000000 7.802824 ”0.661373 ”0.929268 
0.379997 ”0.661373 11.541381 ”0.116645 
1.059649 ”0.929268 ”0.116645 7.000000 


Ri 一 


4 一 


43 一 


After 10 iterations we arrive at 


3.295870 ”0.002521 ”0.0378S9 ”0.000000 
0.002521 ”8.405210 ”0.004957 ”0.066758 
0.037859 ”0.004957 ”11.704123 ”0.001430 
0.000000 “0.066758 ” 0.001430 6.594797 


410 三 
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It will take Six more iterations for the diagonal elements to get close to the diagonal matrix 
妃 = diag(3.295699, 8.407662, 11.704301, 6.S92338). 


However, the off-diagonal elements are not small enough, and it will take three more it- 
erations for them to be less than 10 “in magnitude. Then the eigenvectors are the columns 
of the matrixX Y 一 民 1RR2 .及 18 which is 


0.528779 ”0.573042 0.582298 。” 0.230097 

一 0.591967 ”0.472301 0.175776 ”0.628975 。 
0.536039 ”0.282050 0.792487 “0.071235 | 
0.287454 ”0.607455 ”0.044680 ”0.739169 






Program 11.3 (Jacobi Iteration for Eigenvalues and Eigenvectors)，To compnute 


the full set of eigenpairs 从 六 Y)]-1 ofthe 7 xPrealsymmetric matrix 4 Jacobi 
iteration is used to find all eigenpairs. 


function [V,D]=jacobilt(A,epsilon) 


XInput -~ Ais an nxn matrix 

% ~ epsiLon is the tolerance 

%hDOutput -~ V is the Dxn matrix of eigenvectors 

和 -~ D is the diagonal nxn matTrix of eigenvalues 
%Initialize V,D,and Parameters 

D=A; 

[nm,n]=size(A) ; 

V=eye(n) ; 

State=1 ; 


.hCalculate row P and column q of the off-diagonal element 
%of greatest magnitude in A 
[ml P]=max(abs(D-diag(diag(D)))); 
[m2 q]j=max(nl) ; 
P=p(d) ; 
while(state==1) 
%Zero out DPq and Dqp 
t=D(P,q)/(D(q,q)-DCP,P)) ; 
C=l/sqrt(t"2+1) ; 
S=Cy 七 ; 
R=[c sji-s c] ; 
D([P dj,:)=R'*D([P q] ,:); 
D(:,[p ql)=D(:,[p q]) 刘 ; 
V(:,[P q])=V(:,[P qd])*R; 





SEC. 11.3 JAcoBITS METHOD S91 


[ml pP]j=max(abs(D-diag(diag(D))7)); 
[m2 q] =max(ml1) ; 
P=pP(4q) ; 
if (abs(D(p,q))<epsilonksqrt(sum(diag(D) .~2)V/n)) 
state=0; 
end 
enQ 
D=dqiag(diag(D) ) ; 


了 xercises for Jacobi's Method 


1.。Mass-spring systems. Consider the undamped mass-spring System Shown in Fig- 
ure 11.3. The mathematical model describing the displacements from static equilib- 


Tium is 
大 ] 十 大 > 大 2 0 X1(t) 1 0 0 xD) 0 
记忆 + 让 lz2OI+lo mm 020|=10 
0 K3 K3 X3{(1) 0 0 103 2X3 (四 0 


(a) Use the substitutions xj 0) 一 Vij Sin(oOf 十 9) fory = 1 2, 3, where 0 is a con- 
stant, and show that the solution to the mathematical model can be reformulated 


as follows: 
K1 十 有 2 人 2 
一 一 一 一 一 ul1 ul1 
11 11 
12 XK2 十 K3 1 2 
-一 ”一 一 一 || 妇 =o | 
1112 112 1112 
天 大 
0 -到 也 13 13 
113 113 


(Dj Set 入 = ow2; then the three solutions to part (aj are the eigenpairs 入 六 有 一 
， ， ,了 7 
[92 人 | , for ) = 1 2, 3. Show that they are used to form the three 


0 (0 全 


Figure 11.3 An undamped mass- 
Spring System. 
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fundamental solutions: 


人 1) sin(oj 十 9) 人 7 


了 1 一 | vsinoir+g) | = sin(oir+g9| uv |， 
5 sin(oir 十 9) ug 

where wj 一 VXj fory 一 12,3. 

Rermark. These three solutions are referred to as the 纪 ree prizicipal miodes Oo 

VBPrafiom. 


2， The Pomaogereols zzearsystem of differential equations 


xl 一 xD 二 22 人 
(0 一 2x1(0) 十 4x2( 


can be written in the matrix form: 
， X1 (0) 1 工 [za0 
xoO= [=| 。 -axo 
(a) ”Verify that 2, [1 1] and 3, [1 2] are eigenpairs of the matrix 4. 
(By direct substitution into the matrix form ofthe system, verify thatboth 于 (0 三 
e2f1 1 andaXo) = es 2?] are Solutions of the system of differential equa- 
tions. 

(OO By direct substitution into the matrix form of the system, verify that 天 (1) 一 
cle2 人 [1 吉 十 cze3t[1 2] is the general solution of tne system of differential 
equations. 

Reraark. If the matrix 4 has mn distinct eigenvalues, tnen it will have m lineariy 
independent eigenvectors. In this case the general solution of a homogeneous 


System of differential equations can be written as alinear combination: that is， 
辟 ( 人 (人 一 cleX1V1 十 C2ex21V2 十 … .十 CnexntT 


3. Use the technique (by hand) outlined in Exercise 2 to solve each of the following 
initial value problems. 


gg X1 一 4x1 十 2x2 in Xl1(0) 一 1] 

2 一 3x1 22 X2(0) 一 2 
@) 2 一 2xXl 12x2 with xl1(0) 一 2 

2 一 X1 5Sx2 xX2(0) 一 

2 一 22 X1(0) 一 工 
(9 轨 一 妇 with | mmD)=2 


2 一 8xl 14x2 十 77x3 xX3(0) 一 3 
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Algorithms and Programs 





1. Use Program 11.3 to find the eigenpairs of the given matrix with a tolerance of e 一 
10 7. Compare your results with those obtained from the MATLAB command eig 
by entering [elig(A) diag(D)] inthe MAILAB command window. 


432 1 
343 2 
人 4=|2343 
1234 
225 025 125 2.75 
几 4| 025 225 275 125 


1.243 2.73 2.25 0.25 

2.75 1.29 ”0.25 ”2.25 

人 4=[Iahlwhereaj = andij 12 .30 

记 1 天 1 

cos(Sin(G 十 门 ) 过 = 

z 十 苯 十 1 天 

2.、Use the technique outlined in Exercise f and Program 11.3 to find the eigenpairs and 
the three principal modes of vibration for the undamped mass-spring systems with the 
folljowing coefficients. 


(a) IlI 三 3,j2 一 2,13 一 11 一 1,12 一 17113 一 1 
(后 三 让 妃 = 寺 机 = 下 ml 一 4,m2 二 4,m3 一 4 
(C) KKI =0.2,12 一 0.4, 1 = 0.3,m1 一 2.$,112 一 2.5,103 一 2.$ 


3. Use the technique outiinedin Exercise 2 and Prosgram 11.3 to find the general solution 
of the given homogeneous System of differential equations， 


(a) x 一 4x1 十 3x2 十 273 十 X4 
72 一 3X1 十 4x2 十 373 十 2x4 
2 一 2X1 十 3x2 十 4x3 十 3xX4 
X4 一 XI 十 2x2 十 373 十 4x4 
(b) xi =Sxl 十 4x2 十 3x3 十 2x4 十 X5 
这 一 4x1 十 Sx2 十 4x73 十 3x4 十 2x5 
X3 一 3X1 十 4x2 十 Sx3 十 4X4 十 3X5 
X4 一 2x1 十 3x2 十 4x3 十 Sx4 十 4x5 
X6 一 xl 十 2x2 十 3x73 十 4x4 十 Sx5 
4. Modify Program 11.3 to implement the“cyclic” Jacobi method. 


(d) 4 = [ai where ai 一 | andi, j 一 1,2,...,40. 


S. Use your program from Problem 4 on the symmetric matrices in Problem 1. In par- 
ticular compare the number of iterations required by your cyclic program and Pro- 
gram 11.3to Satisfy the given tolerance. 
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Eigenvalues of Symmetric Matrices 
Householder's Method 


Each transformation in Jacobi's method produced two zero off-diagonal elements, but 
subsequent iterations might make them nonzero. Hence many iterations are Tequjired to 
make the off-diagonal entries Su 值 cliently close to zero. We now develop a method that 
produces several zero off-diagonal elements in each iteration, and they remain zero in 
subsequent iterations, We start by developing an important step in the processS. 


Theorem 11.23 (Householdqer Refection)， 开 下 and 了 are vectors with the Same 
norm, there exists an orthogonal symmetric matrix 己 such that 


(]) 了 = 忆 天 ， 
where 
(2) . 古 三 8 2 卫 研 / 
and 
天 了 
(3) 钱 = 一 -一 一 ， 
| 了 | 


Since P is both orthogonal and symmetric, it follows that 
(4) P 1 = 己 . 


Proof Equation (3) is used and defines 厂 to be the unit vectorin the direction 蕊 了, 
hence 


(3) 栈 ' 厂 =1 

and 

(0) 了 三 天 十 C 仙 ， 

where cc 一 | 王 了 |2. Since 互 and 了 have the same norm, the parallelogram ruje 


forvector addition can beused to see that Z 一 ( 素 十 了)/2 一 下 十 (c/2) 厂 is orthogonal 
to vector 风 (see Rigure 11.4). This implies that 


W' CE+5W) 一 0 
Now we can use (3$) to expand the preceding equation and get 


O) W 宝 二 37' 克 = WE = 0， 
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入 Figure 11.4 The vectors 太 , 互 ,了 ， 
and Z involved in the Householder 
tefection， 


The crucial step ls to use (7) and express c in the form 
(8) C 一 2( 八 了). 
Now (8) can be used in (0) to see that 
了 一天 十 c 钱 一 三 2 了 区 帮 . 
Since the quantity 厂 ' 帮 is a scalar the last equation can be written as 
(9) 7 一 下 2 用人 故 下 =( 2 且 厂 /天 . 
Looking at (9), we see that 书 = 了 2? 厂 研 /. The matrix 已 is symmetric because 
已 =( 人 2 钱 全 ) = 2( 卫 全 修 
= 一 7 2 了 四 = 也 . 
The folowing calculation shows that P is orthogonal: 
忆 尼 =(T 2? 古 帮 )(1 21 
= 了 4 二 厂 ' 十 4 古 研 ' 侠 全/ 
= 了 4 有 厂 厂 ' 十 4 砚 帮 = 了 
and the proof is compjete. 


5$95 


HI shoujld be observed that the effect of the mapping 了 一 己 古 js to reflect 不 


through the line whose direction is Z, hence the name 瑟 orvsejolder re1jiectiom. 


Corollary 11.3 (Kth Householder Matrix). Let 4 be an xm matrix, and 盛 any 
vector IEis an integer with ] < 大 三 2, wecan construct a vector 全 5 and matrix 


有 一 了 2 本 全/ So that 


X1 X1 
7 天 

(10) 用 下 三 玫 | Xi | 三 4 一 了 
0 
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Proof The key is to define the value $ so that | 大 = zl and then invoke Theo- 
rem 11.23. The proper Value for $ must Satisfy 


(11) 3 一 礁 十 大 十 十 
which is readily verified by computing the norms of 不 and 了: 
| 下 上 = 好 十 妇 十 十 这 
= | 六 l2 ， 
The vector 丸 is found by using equation (3) of Theorem 11.23: 
1 
全 = 页 ( 了 ) 
(13) 


1 
= 页 [0 … 0 Got+S) H2 2] 


Less round-off error is propagated when the sign of S is chosen to be the same as the 
Sign of x+1; hence we compute 


(14) S 一 SignaCxtHIDCt LT 十 X 2 十 :十 xD)12. 
The number R in (13) is chosen so that || 太 儿 = 1 and mnust satisfy 
R2 = (zkt+l 十 S) 十 礁 > 十 二 
(15) 一 2xk418S 十 呆 十 夺 十 寻 2 十 :十 夺 
= 2xk415 十 28?. 
Therefore, the matrix 忆 i is given by the formula 
(16) PE 一 了 7 2 耳 佣 /， 


and the proof is complete. e 


Householder Transformation 


Supposethat 4 is asymmetricm xj matrix. Then a sequence ofm， 2 transformations 
of the form P4P will reduce 4 to a symmetric tridiagonal matrix. Let us visualize 
the process when 呈 三 $. The first transformation is defined to be PI14 忆 1, where 疡 1 
is constructed by applying Corollary 11.3, with the vector 互 being the first column of 
the matrix 4. The general form of 瑚 1 is 


(17) 到 1 一 


已 巴 己 口 一 
号 习 喇 
写 届 司 习 口 
写 司 全 习 喇 
号 症 癌 
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Where the letter Pp stands for some element in 忆 1. As a result，the transformation 
Pi4Pli does not affect the element cl1 of 4: 


al 2 0 0 0 
1 巧 | 功 
(18) PI4PI=|0 由 功 山 |=A41， 
0 功 轨 功 
0 芒 功 幼 央 


The element denoted xl is changed because of premultiplication by 忆 1，and zl is 
changed because of postmultiplication by Pil; since 4l is symmetric, we have UI1 一 1. 
The changes to the elements denoted ww have been affected by both premultiplication 
and postmultiplication. Also, since 于 is the first column of 4, eduation (10) implies 
that 1 一 49. 

The second Householder transformation ls applied to the matrix 41 deftined in (18) 
and is denoted P24P2, where P2 is constructed by applying Corollary 11.3, with the 
vector 下 being the second column of the matrix 41. The form of 已 2 ls 


10000 
0100 0 
(19) P2=|00PP P|， 
00DPP P 
00PPD 


whbere D stands for Some element in 忆 22，The 2 x 2 identity block in the upper-left 
cormer ensures that the partial tridiagonalization achieved in the first step will not be 
altered by the second transformation 疡 2412. The outcome of this transformation is 


al 2) 0 0 0 
UL WO 2 0 0 
(20) P241P2=|0 xi 2 贱 功 |=4?， 
0 0 功 功 
0 0 功 轧 功 


The elements x2 and 72 were affected by premnultiplication and postmultiplication 
by 忆 2. Adqitional changes have been introduced to the other elements 内 by the trans- 
formation. 

The third Householder transformation, 忆 342P3, is applied to the matrix 42 de- 
fned in (20), where the corollary is used with 励 being the third column of 4?. The 
form of 殊 3 is 


1000 0 
0100 0 
(21) P3=|001 0 0 
000 PP P 
000 PP PP 
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Again, the 3 x 3 identity block ensures that P3423 does not affect the elements 
of 42, which lie in the upper 3 x 3 corner and we obtain 


al 2 0 0 0 
UL ww 2 0 0 
(22) Pa342P3 王 |0 2 oo 0 0| =43. 
0 0 8 委 切 廊 
0 0 0 妃 岗 


Thus it has taken three transformations to reduce 4 to tridiagonal form. 
For efciency, the transformation 忆 4P is notperformed in matrix form. Thbe next 
result shows that it is more efficiently carried out via some clever vector manipulations. 


Theorem 11.24 (Computation of One Householder Transformation)， If Pisa 
Householder matrix, the transformation P4P is accomplished as follows, Let 


(23) TY = 4 丽 


and compute 


(24) cc 一 厂 "了 

and 

(235) CE=Y  cW. 

Then 

(20) P4P=-4 210 20 克 - 


Proof First form the product 
4P=40 2 印 W)=4 24 环 厂 /. 
Using equation (23), this is written as 
(27) 4 一 4 27 肌 /. 
Now use (27) and write 
(28) P4P=(T 2 灵 帮 1)(4 27 全 /). 


When this quantity is expanded, the term 2(2 厂 研 ' 耻 全) is divided into two portions 
and (28) can be rewritten as 


(29) 忆 4P 一 4 2 丽 ( 卫 4) 十 2 研 ( 卫 下 研 ) 28V 且 ' 十 2 全 (全 /7) 且 /. 
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Underthe assumption that 4 is symmetric, we can usethe identity (本 /4) = (W'40) = 
Y The tricky part is to observethat (全 'Y) is ascalar quantity; hence it can commnute 
freely about in any term.， Another scalar identity 全 "YY = ( 肘 'Y)' is used to obtain 
the relation 了 研 了 研 ' = (全 了) 斌 ' = (了 古 炎 ) = 且 (( 厂 人 ) = (( 厂 'V) 耳 ) 一 
(本 "人 厂 ). These results are used in the terms of (29) in parentheses to get 


(30) 忆 4 忆 一 4 2 卫 克 十 2 卫 ( 夯 下 丽 ) 2287 且 ' 十 2 丽 粘 了 全 /， 
Now the distmbutive law is used in (30) and we obtain 
(31) PA4P=4 2 了 (YY ( 且 V 古 )) 2(87 有 胡 了 且 ) 俘 /. 


Finally, the definition for CQ given in (2S) is used in (31) and the outcome is equa- 
tion (26), and the Proof is complete. @ 


Reduction to Tridiagonal Form 
Suppose that 4 is a symmetric nz x 7 matrix. Start with 


(32) 4o 一 4. 
Construct the sequence 书 1, 忆 2, ...,，1of Householder matrices, so that 
(33) 4 一 Pr4k 1PK for 上 一 1 2 .:.，7m 2， 


where 4k has zeros below the subdiagonal in columns 1, 2, ..., 大 . Then 4，2 is a 
symmetric tridiagonal matrix that is simjlar to 4. This process is called 感 ozsepolders 
112E100d. 


Example 11.8， Use Householder's method to reduce the following matrix to symmetric 
tridiagonal form: 


40 一 


一 ID tb 人 
一 一 DO ID 
二 《CD 中 


1 
| 
1 
2 


The details are left for the reader. The constants 8 = 3 and 尺 = 3012 = $.477226 are 
used to construct the vector 


W' = -局 5 2 1] = [0.000000 0.912871 0.365148 0.182574]. 


Then matrix multiplication Y = 4 砚 is used to form 


”= -高 12 12 9] 


一 [0.000000 2.190890 2.190890 1.643168|]. 
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The constant c = 全 /了 is then found to be 
CC 一 0.9. 
Then the vector @@ =  c 针 = 了 十 0.9 负 is formed: 
1 
/7 之 ”一 一 一 
“项 
= [0.000000 “1.369306 2.519524 1.807484|]. 


[0.000000 “7.500000 13.800000 9.900000] 


The computation 41 = 40 2 了 Of 20 produces 


4.0 3.0 0.0 0.0 
3.0 2.0 2.0 1.8 
0.0 26 0.68 1.24 
0.0 1.8 1.24 0.68 


The final step uses the constants 5 一 ”3.1622777, 及 = 6.0368737,c = 1.2649111 and 
the vectors 


榴 ' = [0.000000 0.000000 “0.954514 ”0.298168]， 
V: = [0.000000 0.000000 1.018797 0.980843]， 
@' = [0.000000 0.000000 ”0.188578 0.603687]. 


The tridiagonal matrix 42 = 41 21Q 20 is 


4.0 3.0 0.0 “0.0 

4 | 30 2.0 3.162278 ”0.0 

2 二 | 0.0 3.162278 1.4 02 四 
0.0 0.0 0.2 1.4 


program 11.4 (Reduction to Triqiagonal Form). To reduce the m xm symmetric 


matrix 4 to tridiagional form by usingm 2 Householder transformations. 





function T=house (A) 
%IDnPut - Ais an DXxn SymmetIic 圈 atIiX 
YoOutput - T is a tridiagonal matrix 
[n,n]=size(A) ; 
for kxk=1:D-2 

YXConstruct 风 

S=Dnorm(A(CK+1:D,k)) ; 

i 〈A(k+t,k)<0) 

=-S 
enaQ 
=Sqrt(2*Ss#(ACK+1,K)+S) ) ; 
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W(1L:x)=zZeros(1 ,K) ; 
WCGk+L)=(ACKtl,k)+S)VATr; 
W(k+2:D)=A(k+2:D,K) 7 /Ti 
%Construct Y 
VCt:Kk)=zeros (1,K) ; 
V(k+1:Dn)=A(Ck+1l:nk+1:n)kw(K+Lt:n) ; 
YConstruct 日 
C=W(K+1:D)#*V(K+1:nD)  ; 
Q(L:K)=zZeros(1,K) ; 
Q(k+1:n)=V(k+1:n)-ckW(k+l:n) ; 
YEForm AK 
A(k+2:Dn,k)=Zeros (n-x-1,1) |; 
A(K ,kt+2:3n)=Zefos(1,n-k-1) ; 
A(K+TL ,KK)=-S; 
A(k,k+1)=-S; 
A(Ck+t:Dn,k+1in)=A(k+t:nk+i:n) ， 
-2*W(K+1T:n)  *QCK+TL:Dn) -2*Q(K+L:Dn) 2*WCK+L:R) ; 
end 
T=A; 


The CR Method 


Suppose that 4 ls a real Symmetric matrix， In the breceding section we Saw how 
Householders method is used to construct a similar tridiagonal matrix，The OCR 
method is used to find all eigenvalues of a tridiagonal matrix. Plane rotations similar 
to those that were introduced in Jacobi's method are used to construct an orthogonal 
matrix @1 = Q and an upper-triangular matrix 1 = 7 sothat 41 = 4 has the 
factorization 


(34) 41= @1051. 

Then form the product 

(35) 42 = 1U10C)1. 
Since Qi is orthogonal we can use (34) to see that 

(G0) 0141 = 010D1: = 避 . 
Therefore, 42 can be computed with the formula 

G7) 42 = 044101. 


Since 0 = @) 1 it follows that 4> is similar to 41 and has the same eligenvalues. In 
general construct the orthogonal matrix @ and upper-triangular matrix CJk so that 


(38) 4 一双 U. 
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Then define 

(39) 4k+1=VreOk = 004505. 

Again, wehave CO = 人 1 , whichnimplies that 4k+land 4x are similar An important 
consequence is that 4k is similar to 4 and hence has the same Structure. Specifically， 


we can conclude that 放 4 is tridiagonal then 4k is also tridiagonal for all 克 ， Now 
Suppose that 4 is written as 


dl el 
el 中 e2 
e2 
(40) 4 一 
如 2 en 2 
enr2 只 1 en1l 
em 1 ar 


We can find a plane rotation 忆 ，1 that reduces to zero the element of 4 in location 
(2, 7 1] ,也 at is， 


dl el 
el de2 
e2 (d 


(41) 忆 ，14 一 
dr2 gn2 mm2 
en2 pnl dr 1 
0 Pr 


Continuing in a similar fashion，we can construct a plane rotation 书 ，2 that will 
reduce to zero the element of P，14 located in position (P， 17 2). Aftermn 1 
steps we arrive at 


Pl 9 略 
0 PP 4 


GD PP ”有 
dan3 Pm3 
Pr2 g 和 2 Pm2 
0 pn 1 9 1l 
0 0 Pn 


Since each plane rotation is represented by an orthogonal matrix, equation (42) implies 
that 


(43) @= Ph 1P4 2 1 
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Direct mujltiplication of V by C will produce all zero elements below the jower 
Second diagonal， Thpe tridiagonal form of 42> implies that it also has zeros above the 
upper second diagonal，Investigation will reveal that the terms rj are used only to 
compute these Zero elements. Consequently, the numbers {r7 do not need to be stored 
or used in the computer. 

For each plane rotation 忆 ) it is assumed that we Store the coefficients cj and y/ 
that define it，Then we do not need to compnute and store @ explicitly; instead we 
can use the sequences {cj] and {sj} together with the correct formulas to unravel the 
Product 


(44) 42 王 0Q=DP，IP 2 ……P. 


Acceleration Shifts 


As outlined above the CR method w 刘 work，but convergence is slow even for ma- 
trices of small dimension，We can add a shifting technique that speeds up the rate of 
convergence. Recall that 让 入 j is an eigenvalue of 4 then 和 j) Siis an eigenvalue of 
the matrix 妃 王 4 37. This idea is incorporated in the modified step 


(45) 4 537 一 Ci; 
then form 
(40) 4i+L=ViG@i for 一 1 2 .大 )， 


where {Sij is a Sequence whose sum is 入 ) that is， 人/ 一 8 十 3S2 十 .… 十 S6i 

At each stage the correct amount of shift is found by using the four elements in the 
lower-right corner of the matrix. Start by finding 和 1 and compute the eigenvalues of 
the 2 x 2 matrix 


(47) 民 1 Cn 中 


em 1 dz 
They are xl and x2 and are the roots of the quadratic equation 
(48) 六 (1+d)xz+ 丰 1 en ien 1=0. 


The value si in equation (45) is chosen to be the root of (48) that is closest to d 

Then CR iterating with shifting is repeated until we have es，1 居 0 This will 
produce the first eigenvalue 和 1 = 31 十 2 十 … 十 Si. Asimilar process is repeated with 
the Upper7m 1 rows to obtain e，2 六 0, and the next eigenvalue is 和 2. Successive iter- 
ation is applied to smaller submatrices until we obtain ez 交 0 and the eigenvalue 和 ，). 
Finaly, the quadratic formula is used to find the last two eigenvalues. The details can 
be gleaned from the program. 





604 CHAP. 11 EIGENVALUES AND EIGENVECTORS 


了 }xampjle 11.9. Find the eigenvalues of the matrix 
4 22 1 
2 3 1 1 
“=|2 131 
1 1 1 2 
InExample 11.8,atridiagonal matrix 41 was constructedthat is similar to M. We Start 
our diagonalization process with this matrix: 


4 3 0 0 
有 3 2 3.16228 0 
1 一 | 0 3.16228 14 0.2 
0 0 0.2 1.4 
The four elements in the lower right comnerare 中 = 1.4,d = 1.4,andes= 0.2and 


are Used to form the quadratic equation 


xz (14+14xz+( 1.4)(14) (02)(0 02)= 妇 2=0. 


Calculation produces the roots xX1 一 1.41421 and x? = 1.41421. The root closest to 届 
is chosen as the first shift sl = 1.41421, and the first shifted matrix is 


2.38379 3 0 0 

4 397 一 3 0.58579 ”1.74806 ”0 
0 1.74806 ”2.81421 1.61421 
0 0 1.61421 0.01421 


Next the factorization 41 17 = OU1is computed: 


0.65288 ”0.38859 ”0.55535 ”0.33814 


ovi = 0.7$746 ”0.33494 ”0.47867 ”0.29145 
1 1 一 | 0 0.85838 。” 0.43818 ”0.26610 
0 0 0.52006 ”0.8S$413 
3.900S9 2.40235 2.395S31 0 
、 0 3.68400 “3.47483 ”0.17168 
0 0 0.3845S7 0.08024 
0 0 0 0.065S0 
Then the matrix product is computed in the reverse order to obtain 
4.40547 2.79049 0 0 
4 =Ui0) = 2.79049 ”4.21663 ”0.33011 0 
2 “< 一 |0 0.33011 ”0.21024 ”0.03406 
0 0 0.03406 0.0S595 
The second shift is s2 一 ”0.06024, the second shifted matrix is 4? 827 一 CC2V2,and 
4.$$2S7 2.60$725 0 0 
4 = UO, = 2.6$724 ”4.26047 0.01911 0 
3 一 “2<2 二 | 0 0.01911 0.29171 “0.00003 


0 0 0.00003 ”0.00027 
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The third shift is s3 三 0.00027, the third sbifted matrix is 43 ”537 = 一 CO3U3, and 


4.62640 ”2.53033 0 0 
2.53033 “4.33489 ”0.00111 0 
44=053ats=|0 0.00111 ”0.29150 0 
0 0 0 0 


The first eigenvalue, rounded to 5 decimal places is given in the calculation 
和 1 一 51 十 92 十 353 一 1.41421 0.06023 十 0.00027 = 1.35425. 


Next 和 1 is placed in the last diagonal position of 44 and the process is repeated, but 
changes are made only in the upper 3 x 3 corner of the matrix 


4.62640 ”2.53033 ”0 0 
4 |253033 433489 0.00111 0 
4 |0 0.00111 “0.29150 0 

0 0 0 1.35425 


In a similar manner，one more shift reduces the entry in the second row and third 
column to zero (to ten decimal places): 


434 一 0.291S0， 34 了 一 C4774， 5 一 40C4. 
Hence the second eigenvalue is 
和 2 一 和 ! 十 594 一 1.3S425 十 0.29150 = 1.64S75. 


REinally, 和 2 is Placed on the diagonal of 45 in the third row and column to obtain 


4.26081 “2.65724 0 0 
4 2.65724 ”4.55232 0 0 
5 一 | 0 0 1.64575 0 
0 0 0 1.35425 


The final computation requires finding the eigenvalues ofthe 2 x 2 matrix in the upper-left 
corner of 45. The characteristic equation is 


xz ( 4.26081 + 4.55232)x 十 (4.26081)( 4.55232) (2.65724)(2.65724) 一 0， 
Which reduces to 
x2 十 0.29151x ”26.45749 = 0 


The roots arexl = $.00000and xz 一”5.29150,andthe last two eigenvalues are computed 
with the calculations 


和 3 二 和 2 十 Xl 一 1.04575 二 5$.0000 = 6.64575 


and 


人 4 一 人 2 十 xi2 三 1.64375 ”3$.29130 = 3.64575. 
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Program 11.5 can be used to approximate all the eigenvalues of a symmetric tridi- 
agonal matrix， The program follows directly from the previous discussion, but with 
two notable exceptions. First, the MAILAB command eig is used to find the roots 
of the characteristic equation (48) of each 2 x 2 submatrix (47)，Second, the CR 
factorization of the matrix 4i Si (43) is executed using the MATILAB command 
[IQ,R] =qr(B), which produces an orthogonal matrix Q and an upper-triangular matrix 
R, such that B=Q*R (readers will be askedto write their own COR factorization progratm). 


Program 11.S (TIhe CR Method with Shifts)，To approximate the eigenvalues of 


asSymmetric tridiagonal matrix 4 using the OCR method with shifts. 





function D=qr2(A,epsilon) 


%Input -Ais a symmetric tridiagonal Dxn mmatTrix 
% ~ epsilon ie the tolerance 
X%Dutput - D is the nxl vector of eigenvalues 


%Initialize Parameters 
[n,n]j=size(A) ; 

m=Dn; 

D=zeros (mn ,1); 

B=A; 


while (m>1) 
While 《abs(B(m,m-t))>=epsilon) 


%Calculate Shift 
S=eig(B(m-1:zm,m-t:zm)) ; 
[jj ,KJ]=min(C[abs(B(n,m)*f[fl 1]:-S)]); 


XVQR factorization of B 
[Q,U]=qr(B-SCk)*eye(m)) ; 


YCalculate next 了 B 
B=U*Q+S (K)*eye (m) ; 
enQ 


YP1lace mth eigenvalue in A(m,m) 
A(1:m,1:m)=B; 


%Repeat Process on the m-1 x m-1 submatrix of A 
In=m-T; 
B=A(1:m,1:m) ; 

end 

D=diag(A) ; 
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卫 xercises for Eigenvalues of Symmetric Matrices 





1 In the proof of Theorem 11.23, carefully explain why Z is perpendicular to 三 ， 
2. 于 奢 is any vectorand 己 王 7 2 互 环 , show that 忆 is asymmetric matrix， 
3. Let 下 be any vector and set 尸 一 了 2 于 大/ 
(a) Find the quantity 忆 ' 己 . 
(b) What additional condition is necessary in order that 己 be an orthogonal matrix? 


Algorithms and Programs 
| 


In Problems 1 through 6 use: 
(a) Program 11.4 to reduce the given matrix to tridiagonal form. 
(b) Program 11.5 to find the eigenvalues of the given matrix. 


3 2 1 43 2 1 2.75 0.25 0.75 1.25 
1 |2 3 ，》 2 343 2 3 0.25 2.75 1.253 ”0.75 
“ 1 >? 3 “|234 3 “ 0.75 1.23 2.75 ”0.25 
1 23 4 1.25 0.73 0.2$3 2.75 

3.6 44 0.8 1.6 2.8 


5. 4= [alwhereaj = 站 = andij 12.....30， 
1 7 关 7 

cos(SsinG 十 门 ) 霸 = / 

1 十 太 十 7 zi 天 

7，Write a program to carry out the CR method on a symmetric matrix. 


06. 4 王 [ai 门 ,where aij 一 | and 1 了 一 1， 2， 。。 .40. 


8. Modify Program 11.5 to call your program from Problem 7 as a subroutine. Use this 
modified program to find the eigenvalues of the matrices in Problems 1 through 6. 








Appendix: 
An Introduction to MATILAB 


This appendix introduces the reader to programming with the software package MAT- 
LAB. It is assumed that the reader has had previous experience with a high-level pro- 
gramming language and is familiar with the techniques of writing loops，branching 
using logical relations, calling subroutines, and editing. These techniques are directly 
applicable in the windows-type environment of MATLAB. 

MAILAB is a mathematical software package based on matrices，The package 
consists of an extensive library of numerical routines, easily accessed two- and three- 
dimensional graphics, and a high-level programming format， The ability to quickly 
implement and modify programs makes MAILAB an appropriate format for exploring 
and executing the algorithms in this textbook. 

The reader should work through the following tutorial introduction to MATLAB 
(MAILAB commands are in typewriter type). The examples illustrate typical input 
and output from the MAILAB Command Window， To find additional information 
about commands, options, and examples, the reader is urged to make use of the on-line 
help facility and the Reference and User's guides that accompany the software. 


Arithmetic Operations 


十 Addition 

~ Subtraction 
六 Multiplication 
/ Division 

” Power 
Pi，e，i Constants 
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Ex .>>(2+3*pPi)V2 
ang = 
5.7124 


Built-in 了 functions 


Below is a short list of some of the functions available in MAILILAB. TIhe following ex- 
ample illustrates how functions and arithmetic operations are combined, Descriptions 
of other available functions may be found by using the on-line help facility. 

abs (#) cos (#) exp (#) Log(#) 1og10 (#) coshn (#) 

Sin(#)》 tan(#) Sqrt(#) floor(#) acos(#) 七 anh( 提 ) 
Ex.， >>3*cos(sqrt(4.7)) 

ang = 

-1.6869 


The default format shows approximately five significant decimal fgures， Entering the 
command format Jong will display approximately 15S significant decimal figures. 
Ex.， >>format 1Long 
3*cos(sqrt(4.7)) 
ang = 
-1.68686892236893 


Assignment Statements 


Variable names are assigned to expressions by Using an equal Sign， 
Ex，>>a=3-f1loor (exp(2.9)) 
六 工 
-15 


A semicolon placed at the end of an expression Suppresses the computer echo (output). 


Ex. >>b=sin(a) ; Note: b was not displayed. 
>>2*#*b”2 
anS= 三 
0.8457 
Deftining Functions 


In MAILAB the user can define a fonction by constructing an Mrfille (a fle ending 
in .m) im the M-fhile EditovDebugger Once defined, a user-defined fonction is called 
in the same manner as built-in functions. 
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Ex .Place the function fun(xz) 1 十 x 2x2/4in the M-fhile fun.m， In the 
EditorvDebugger one would enter the following: 
function y=fun (xy) 
y=1+Xx-Xx. “27/4; 
We will explain the use of “ . ”shortly. Different letters coujd be used for the variables 
and a different name could be used for the function, but the same format would have 
to be foliowed. Once this function has been saved as an M-file named fun.m, it can be 
called in the MAILAB Command Window in the same manner as any function. 
>>cog(fun(3)) 
ans= 
-~0.1782 
A useful and efficient way to evaluate functions js to use the feval command，This 
command requires that the function be called as a string. 
Ex. >>feval(:fun): ,4》 
ans= 
1 


Matrices 

All variables in MATLAB are treated as matrices or arrays，Matrices can be entered 
directly: 

Ex，>>A=[12 3;456;7 89] 


Semicolons are used to separate the rows of a matrix，Note that, the entries of the 
matrix must be Separated by a single space，Alternatively，a matrix can be entered 
IOW by row. 


Ex.>>A=[1 2 3 
456 
7 8 9] 
站 = 
123 
456 
789 
Matrices can be generated using built-in functions. 
Ex. >>Z=zeros(3,5) ; createsa3 x 9 matrix of zeros 
>>X=ones(3 ,5) ; creates a3 x 9 matrix of ones 
>>Y=0:0.5:2 creates the dispiayed 1 x $ matrix 


Y= 
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0 0.5000 1.0000 1.5000 2.0000 


>>Ccos(Y) createsal x S matrix bytaking the 
cosine of each entry of Y 
ans= 
1.0000 0.8776 0.5403 0.0707 -0.4161 


The components of matrices can be manipulated in Several waysS. 


Ex. >>A(2,3) select a single entry of A 

amnS= 王 

6 
>>A(1:2,2:3) select a Submatrix of A 
anS= 

2 3 

5 6 
>>A([L 3] ,[1 3]) another way to select a Submatrix of A 
angs= 

1 3 

7 9 


>>A(2,2)=tan(7.8); assign anew valueto an entry of A 
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Additional commands for matrices can be found by using the on-line help facility or 


consulting the documentation accompanying the software， 


Matrix Operations 


十 Addition 

一 Subtraction 

永 Multiplication 

” Power 

) Conjugate Transpose 


Ex. >>B=[1 2;3 4] ; 


>>C=B， Cis the transpose of B 
1 3 
2 4 

>>3*+ (BrC) ~3 3(BC)3 

amng= 


13080 29568 
29568 66840 


0l12 APPENDIX: AN INTRODUCTION TO MATLABR 


Array Operations 


One of the most useful characteristics of the MATILAB.package is the number of func- 
tions that can operate on the individual elements of a matrix. This was demonstrated 
earlier when the cosine of the entries of a 1 x S$ matrix was taken. The matrix oper- 
ations of addition, subtraction, and scalar multiplication already operate elementwise， 
butthe matrix operations of multiplication, division, and power do not. These three op- 
erations can be made to operate elementwise by Preceding them with a period: .*，. /， 
and .~ Iais important to understand how and when to use these operations. Array op- 
erations are CTUcial to the efficient construction and execution of MATLAB programs 
and graphics. 


Ex， >>A=[I1 2;3 4] ; 


>>A”2 produces the matrix product AA 
ans= 
7 10 
15 22 
>>A. ”2 Squares each entry of A 
anS= 
1 4 
9 16 
>>cos (A./2) divides each entry of A by 2, then takes 
the cosine of each entry 
ans= 
0.8776 0.5403 
0.0707 -0.4161 
Graphics 


MALLAB can produce two- and three-dimensional plots of curves and surfaces. Op- 
tions and additional features of graphics in MATLAB can be found in the on-line fa- 
cility and the documentation accompanying the Software. 

The plot command is used to generate graphs of two-dimensional functions, The 
following example will create the plot of the graphs of y = cos(x) and y = cos2(z) 
over the interval [0, 雯 ]. 

Ex. >>x=0:0.1:pIi; 

>>y=Ccos (x) ; 

>>Z=CcoSs (x) . “2; 

>>pPIot(Xx,y,Xx,Z，:o)?) 
The first line specifies the domain with a step size of 0.1. The nexttwo lines define the 
two functions. Note that, the first three lines all end in a semicolon. The semicolon is 
Decessary to Suppress the echoing of the matrices x, y, and z on the command screen. 
The fourth line contains the plot commandthat produces the graph. The first two terms 
in the plot command, x and y,Plot the function 一 cos(x)，The third and fourth 
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terms, x and z, produce the plot of ， 一 cos2(x)、 The last term，*o，, results in os 
being plotted at each point (Xk, zk) Where zk 一 cOS2(xp). 

In the third line the use of the array operation“. ”is critical，First the cosine of 
each entry in the matrix x is taken, and then each entry in the matrix cos (x) is squared 
using the .” command. 

The graphics command fplot is a useful alternative to the Plot command. The 
form of the command is fplot (name: , [a,b] ,n). This command creates a plot of 
the function name .m by Sampling 7? points in the interval [a, 8] The default number 
for n ls 25. 


EX. >>fpPlot('tanh7,[-2,2]) plots y= 一 tanh(x) over[ 2,2] 
ThepPlot andPlot3 commands are used to graph parametric curves in two- and three- 
dimensional space, respectively. These commands are particularly useful in the visu- 
alization of the solutions of differential equations in two and three dimensions 
Ex，The piot ofthe ellijpse c(0) = (2cos(,3sin(t)), where0 <L < 2r,is produced 

with the following commands: 

>>t=0:0.2:2+kpji; 

>>P1lot(2*cos(t) ,3ysin(t)) 
Ex. The plot of the curve c(D) 三 (2 cos(r)，， 1/hb, where 0.1 < < 4 is pro- 

duced with the following commands: 

>>t=0.1:0.1:4*pi; 

>>P1lot3(2+cos (t) 水. 2,1./t) 
Three-dimensional surface plots are obtained by specifying a rectangular subset of the 
domain of a function with the meshgrid command and then using the mesh or surf 
commands to obtain a graph. These graphs are helpful in visualizing the solutions of 
Partial differential equations. 
EX .>>X=-Pi:0.1:Pii; 

>>y=xXj 

>> [x,y] =meshgrid(x,y); 

>>Z=Sin(cos (x+y) ) ; 

>>mesh(z) 


Loops and Conditionals 


Relational Operators 


== Equal to 

“= Not equal to 

< Less than 

> Greater than 

<= Less than or equal to 


>= Greater than or equal to 


614 ApPPENDIX: AN INTRODUCTION TO MATLAEB 


ELogical Operators 

~ Not (Complement) 

放 And (True 让 both operands are true) 

| Or (True 过 either or both operands are true) 
Boolean Values 

1 True 

0 False 


The for, if,andwhilestatements in MAILAB operatein amanneranalogous to their 
counterparts in other programming languages，These statements have the following 
basic form: 
for (loop-variable = loop-expressiom) 
executable-statements 
enda 


if (logical-expression) 
execuftabjle-statements 
else (logical- expressiom) 
executable-statements 
end 


While (while-expressiom) 
eXecutable-statements 
end 


The following example shows how to use nested loops to generate a imatrix，The 
following file was saved as a M-file named nest .m， Typing nest in the MATLAB 
Command Window produces the matrix A. Note，when viewed from the Upper-left 
corner that the entries of the matrix A are the entries in Pascal's triangle. 

EX. for i=1:5 
A(i,t)=1;A(CT,i)=1; 
end 
for i=2:5 
for j=2:5 
A(i ,j)=A(i ,]j-1)+AC-1 ,]j) ) 
endQ 


The break command is used to exit from a loop. 
EX， for k=1:100 
X=SqIrt (K) ; 
if 〈《(k>10)&(x-floor(x)==0)) 
break 
endQ 
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enda 
区 
The disp command can be used to display text or a matrix. 
Ex，D=10; 
k=0 ; 
While K<= 了 T 
X=K/3 
disp([x x"2 x>“3]) 
k=k+1; 
end 


了 Programs 


An efficient way to construct programs is to use user-defined functions. These func- 
tions are saved as Mr-files，These programs allow the user to specify the input and 
output parameters. They are easily called as subroutines in other programs. The fol- 
lowing example alljows one to visualize the effects of moding out Pascal's triangle with 
a prime number， Type the following function in the MAILAB EditovDebugger and 
then save it as an M-file named pasc .m. 


Ex. function P=pasc(Cn,my) 
%Input - Dn is the number of roVws 
从 -~ 了 is the Prime number 


yX0Output - P is Pascals triangle 


for j=1:D 
P(j,1)=1;P(1,J)=1; 
enDdQ 
for X=2:D 
for j=2:Dn 
P(k,j)=rem(P(k,j-1) ,m)+rem(P(k-l,j),m); 
end 
end 


Now in the MALILAB Command Window enter P=pasc(5,3) to see the first fiverows 


of Pascal's triangle mod 3. Ortry P=pasc(175,3) ; (notethe semicolon) and thentype 
SPy(P) (generates a sparse matrix for large values of 7m). 


Conclusion 


At this point the reader should be able to create and modify programs based on the 
algorithms in this textbook.， Additional information on commands and information 
regarding the use of MATLAB on your particular platform can be found in the on-line 
help facility or in the documentation accompanying the software. 
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Answers to Selected 卫 Xercises 


Section 1.1 和 eview of Calculus 
1 四 工 = 2,{oj=| 直 Timeoe =0 


3. (aj) c=1 v2 

4. (a) MI = 5S/4,HM2 = 
S. (al) c 一 0 

6. (a) Cc 一 1 

7. cc 一 4/3 

9. (a) xz2 cos(x) 


10. (a) c 三 士 /13713 

1 (a) 2 (b) 1 

1S. 13T /3, apply the Mean Value Theorem for Integrals 

16.Let the m roots of P(x) be x0, xl .Jr 1， Verify that the hypotheses of the 
Generalized Rolle's Theorem are Satisfied，Therefore, there exists CE (aq,Db) 
such that Po Dec) = 0. 

Section 1.2 Binary Numbers 


1 (3a) The computer's answer is not 0 because 0.1 is not an exact binary fraction. 
(b) 0 (exactly) 


631 


632 ANSWERS TO SELECTED EXERCISES 


人 


ja 
| 


13， 


14. 
1S， 
16. 
17， 


Section 1.3 Error Analysis 


工 


。(a) 21 
。(a) 0.84375 

。(a) 1.4140625 
. (a) V2 
。、(3) 10111lwo 

。(a) 0.0111We 
、(a) 0.0001ltwo 
。(3) 0.006250000 . . . 
. Usec= 启 andr= 击 togetS==- 一 


(9) 


-ae 


(a) 志 = 0.lthree 
(Ga) 10 = 20fve 


(c) 254 


(c) 0.6640625 


1.4140625 = 0.0001S1062 ... 


[vv 


A 


久 0.100liwe x2 0 
0.101lwe x2 ? 


忆 


0.101lwox2 1 
0.1101llwo x2 “ 


人) 于 = 0.2fve 


(a) x 一 2.71828182, 世 = 2.7182, (x 


人) 到 = 0.ltnree 
(c) 721 = 10341hve 


(ce) 101111010wo 
(c) 0.10111two 
(ej] 0.001，。 


3 


0.101lw。 x2 1 
0.01101ll。 x2 1 
0.10001liw。x2 0 


0.100lwo。 xx 20 
0.00101ltwo x2 0 


0.10111ltwox2 0 羡 |0.1100w。 


(3) 10 = 10lthree (ec) 421 = 120121three 


(G 人)/x =0.00003010,four significant digits 


1 ] 


1 





1 


”450 十 7 二 末 46880 
六 方 = 0.0000000178, (p。 方 )/p = 0.0000000699 


292,807 


区 ) = 0.00008182， 


一 0.2353074428 一 育 


3. (9) pl 十 户 =1.414 十 0.09125 = 1.505， P1p2 = (1.414)(0.09125) = 0.1290 


4. The error involves loss of significance. 


(9) 


0.00001 


。(a) In((xz 十 2)/x) orln(1 二 1) 


0.70711385222 ”0.70710678119 ”0.00000707103 
”0.000001 


(c) cos(2x) 





一 0.707103 
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6. (a) P(2.72) = (2.72)3 3(2.72) 2 十 3(2.72) 1=20.12 22.19+8.16 1 
= 2.07 十 8.16 1=6.09 1=S.09 
(2.72) = ((2.72 3)2.72 十 3)2.72 1=(( 0.28)2.72 十 3)2.72 1 
=( 0.7616 二 3)2.72 1=(2.238)2.72 1=6.087 1 
三 3.087 
R(2.72) = (2.72 ”13 = (1.72)3 = 5.088 
7.(a) 0.498 (bj 0.499 








1 玉 2 
9. (3a) T 十 cos(j) 一 2 十 瑚 十 万 久 十 DO(p4) 
() 1 sD1+A 二 到 二 全 + On4) 
站 二 “2 


Section 2.1 Iteration for Solving zx = 8g(x) 


荆 (a) 8 C[0, 1],8 maps [0, 1] onto [3/4, 1 S [0, 1], and lg =| zx/2| = 
x/2 < 1/2 < 1 on [0, 1]. Therefore, the hypotheses of Theorem 2.2 are satisfied 
and g has aunique fxed point on [0, 1]. 


2. (a) 8(2) = 4+8 2=2,8(4) = 4+16 8=14 
(b) po 一 1.9 尼 0 王 0.1 Ro = 0.0S 
P1 = 1.795 匹 1 王 0.205 及 1 = 0.1025 
P2 一 1.$S689875 2 = 0.4310125 R2 = 0.21$90625 
p3 = 1.04508911 匹 3 一 0.95491089 Ra3 = 0.4774S5S444 
(e) The sequence in part (b) does not convergeto 已 = 2. The Sequence in part (c) 
converges to 己 = 4. 
4. 已 =2,8'(2) = S,iteration will not convergeto 已 = 2. 
5. P = 217 where m is any integer 8 (P) = 1; Theorem 2.3 gives no information 
Tegarding convergence. 
9. (a) 8(3) = 一 0.$(3) 十 1.5= 3 
(@) Proof by mathematical induction. Ifz = l,then|P 中 =jP pol/21 
by part (b), Induction hypothesis: Assume that |P mxl=IP mo /2k. Show 
statement is true for7 一 大 十 下 


IP Prll=|IP 愉 I/2 (by part (b)) 
= (|P pol/26)12 (induction hypothesis) 
=|P Pol/24+1. 
用 
10. a) lt ml -| 二 |- 


1Pk+1| 








玫 
2 
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Section 2.2 ”Bracketing Methods for Locating a Root 


|， 


1 加 =(0.11 十 0.12)/2 三 0.115 4(0.11S) = 254,403 
五 王 (0.11 十 0.11S)/2 = 0.1125 4(0.1125) = 246,072 


.=(0.1125 二 0.119)/2 = 0.113754 4(0.113793) 一 2S0,198 
。There are many choices for intervals [a, p] on whjich (ca) and (bp) have opposite 


Sign. The following answers are one Such choice, 


(a) j1) < 0and F2) > 0, so there is arootin [1,2]; alkso F( 1) < 0and 
FF 2) > 0,sothereis arootin[ 2， 旭 . 


(c) 太 3) < 0 and F(4) > 0, so there is aroot in [3, 41]. 


.CO 三 1.8300782,cl = 1.84092S$2,c2 一 1.84138S4,c3 = 1.8414048 
.5C0 一 3.6979349, cl = 3.6935108, c2 一 3.6934424, c3 = 3.6934414 

开 | 
14. 


Find N suchthat ar <5x10 9 


The bisection Imethod wii never converge (assuming that cn 和 关 2) toy 三 2. 


Section 2.3 Initial Approximation and Convergence Criteria 


1 
3. 
5. 


There is arootnearxy 一 0.7. The interval[ 1, 0] could be used. 
Thbere is aroot nearx 一 1.The intervalf 2,2] could be used. 


There is one root near xz = 1.4. The interval [1, 2] could be used， There is a 
second Toot neary = 3. The interval [2, 4] could be used. 


Section 2.4 Newton-Raphson and Secant Methods 


工 . 


2 
_ 1 
(a) 殉 三 8(PE 1) 一 2 
人 b) po 王 1.$, pl = 0.125, p2 一 2.6458, p3 一 1.16S1 


. (3) 殉 王 8(PE 了 一 字 PE 1 十 到 


(b) po = 2.1, p1 = 2.075, pa = 2.0561, p3 = 2.0421, p4 = 2.0316 


、(a 下 三 8 TD 一 pf 1 十 cos(PK 1 
, (9 8 = 下 PT 


(tb) Po 王 0.20 (c) po =20.0 
pl 一 0.05 P1 一 21.03263138 
P2 一 “0.002380953 P2 = 22.10230034 
P3 三 ”0.000005655 2D3 = 23.14988809 
P4 三 “0.000000000 P4 一 24.19503505 
mm Pr 二 00 由。 寿 二 亿 


。 po0 一 2.60, p1 一 2.9, p2 一 2.4193S484， D3 = 一 2.41436464 
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14. No, because (xz) is not continuous at the root P =.0. You could also try com- 
puting terms with g8(Pk U) = 2 1andseethatthe sequence diverges， 


和 <( (2X 全 1 xx 十 3d) 
22. aj sg=x 二 “|1 二 二 -02 


2x 2(2x)2 3x2 十 4 
= 1Sx 十 x3 
3 一 5 十 37 
P1 = 2.2392941176, p2 = 2.2300079775, 13 = 2.2360679775 
2 十 4x 十 2x2 十 2X3 
b = 人 一 一 全 一” 
四 8 一 一 3 二 条 十 2 
Dli = 2.0130081301, p2 = 2.0000007211, p3 = 2.0000000000 


Section 2.S ”Aitken's, Steffensen”s, and Mujller's Methods 


2. (8) A? 囊 =A(Apm) =A(pn+l pm =(pn2 prD (pn Po 
= pr+2 2pn+l 十 一 20+2)2 二 1 2020+1D2 二 DT 
+212 二 1=4 


6. 1 一 1/(42 十 4 7 









dn Aitken's 





0.00390619 
0.00097656 


0 | 0.5 0.26437542 
1] | 0.23$29412 0.001$8492 
2 | 0.0622S681 0.00002390 
3 | 0.01S62119 0.00000037 
4 
4 


7. gCr) = (6 十 x)L2 









an Aitken's 








2.5 
2.91547595 
2.98587943 
2.99764565 
2.99960758 
2.99993460 


3.00024351 
3.00000667 
3.00000018 
3.00000001 


人 人 一 王 
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9. Solution of cos(x) 1=0. 






pn Steffensen's 









0.5 
0.24465808 
0.12171517 
0.00755300 
0.00377648 
0.00188824 
0.00000003 


11，The sum of the infinite Series is 9 一 99. 












0.99 
1.9701 
2.940399 
3.90099501 
4.85198506 
S$.79346521 


98.9999988 
99.0000017 \ 
98.9999988 
98.9999992 


人 An 上 (Li 一 





13. The sum of the infinite series is $ 一 4. 
1S. Mullers method for Foxz) =x3 xx 2. 






0 2.0 

1 ， 1.472 

2 | 1.4 0.656 

3 | 1.32495614 | 0.02131598 
4 | 1.52135609 | 0.00014040 
5 


1.52137971 | 0.00000001 


Section 3.1 Introduction to Vectors and Matrices 
1. 人 D(a) (1,4) (b) (S$， 12) (c) (9， 12) (9) 5 (el) ( 26, 72) 
人 38 (人 ) 2V1465 
2. 9 = arccos( 16/21) 沁 2.437045 radians 


3. (a) Assume that 不 ,了 和 关 0. 天. 工 =0Oiffcos(9)=0i 在 9 = (2m 十 1) 节 利于 
and Y are orthogonal. 
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放 J = i 一 1/ 
6、(c) 0 一 三 人 
人 | + 了 关 ; | 订 二 7 工头 7 
Section 3.2 ”Properties of Vectors and Miatrices 


L 4B8=| 11 4] 15 2 


13 24|， 84=| 已 20 


3. (a) (4B)C = 4(BC) 三 | “ 


88 ”5S6 
S。(3) 33 (c) The determinant does not exist because the matrix is not square，. 
8. (4B)(B 1I4D = 4(BB 0D41 = (41D41 = 441= 7 Similarly， 


(了 B 14 0(4) = 7. Therefore, (4B) 1 一 互 14 1. 
10. (a) MN (MON 1 


] 1 2 
14. 下 不 ' = [6]， 天 大王 1 1 2 
2 2 4 
Section 3.3 Upper-triangular Linear Systems 
1. xz 一 2,z2 一 233 三 1x4 三 3,anddet4 一 120 
S. XI 一 3,22 王 2,X3 二 1X4 一 landdet4 王 24 


Section 3.4 Gaussian Elimination and Pivoting 
1. xl 一 3,x2 一 2X3 一 工 
S.y 一 5 3x 十 2x2 
10. xi 一 1z2 三 3,x3 一 2 24 一 2 
1S. (a) Solution for Hilbert matrix 4: 
Xl 一 2$,x2 一 300,x3 = 105$0, 14 三 1400,x5 一 6030 
(pb) Solution for the other matrix 4: 


X1l 一 28.02304, xz2 一 348.$887,xa3s 一 1239.781 
X4 一 1666.785,x5 一 753.3564 


Section 3.S ”Triangular Factorization 


la7=[4123]， =[321] 
() Z=[20399]， 怀 =[573] 


3 2 1 1 0 0 和 2 1 
3. (3) 10 3|=| 02 1 0 0 0.4 2.8 
3 1 6 0.6 5 1 0 0 10 


5.a 7Y =[8 6122，X=[3 1132] 
YY=[286121， 居 =f1l29 


roomoneeeievetreoenvoper 
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6. The triangular factorization 4 一 了 7 is 


1 0 0 0|111 1 0 4 
2 1 0 0|i0 3 5 8 
| 5 1 10llo 0% 4 0 
3 1 17$ 1||0 0 0 7.S 
Section 3.6 Iterative Methods for Linear Systems 
1.。 (3a) Jacobi iteration . (bj Gauss-Seidel Iteration 
疡 三 (3.73, 1.8) 忆 = (3.7$, 1.0S) 
户 = (4.2, 1.05) 户 = (4.012S, 0.9975) 
户 = (4.0125, 0.96) 户 = (3.999375, 1.000125) 
Iteration will converge to (4, 1)， Iteration will converge to (4, 1)， 
3. (al) Jacobi iteration (b) Gauss-Seidel iteration 
疡 =( 1，]1) 疡 三 ( 1，4) 
已 一 ( 4，4) 已 三 ( 13，40) 
疡 =( 13，13) 户 一 ( 121，361) 
The iteration diverges away The iteration diverges aWay 
from the solution 忆 = (0.5, 0.5)， from the solution 已 = (0.5, 0.3). 


S. (3a) Jacobi iteration 

户 = (2, 1.375, 0.73) 
户 = (2.12$, 0.9687S, 0.90625) 
户 = (2.0125, 0.93703125, 1.0390625) 
Iteration will convergeto 尼 = (2, 1, 1)， 

(b) Gauss-Seidel iteration 
已 = (2 0.875, 1.03125) 
忆 = (1.96875, 1.0117187S, 0.9892S7813) 
忆 三 (2.00449219, 0.997$3418, 1.0017395) 
Iteration will convergeto 已 = (2, 1, 1)， 


9 (15): | 天 由 王 六 亿 i xl 王 0i 进 lx 三 0for 大 三 0,1... ,Ni 这 三 =0 
016: 1cX 人 = 开 所 icexztl = 亿 ilcllxztl= ic = cl 
Section 3.7 Iteration for Nonjlinear Systems 


1. (aj) x 一 0,y 一 0 (cj) X 一 0,y 一 27 克 
2. (al) YY 一 4,y 一 2 (c) xx 一 0,y=(2n 十 1)r/2 
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1 天 y/4 0.1 0.S 
S.J(C, y) 三 |。 xz)/2 (2 省 ， 7 20) 二 | 0.05 0 


Fixed-point iteration 


1.1 
1.12 

1.1163508 
1.1165151 








Seidel iteration 








2.0 
1.9964 

1.9966327 
1.9906032 











7.0=x yy 0.20=72 03 


Solution of the linear System: J(PK)dP= 开 ( 王 /) 




























1.2 2.4 1.0 0.0075630| 0.04 1.192437 
1.2 1.0 2.4 0.0218487 | 0.06 1.221849 
1.192437 2.384874 1.0 0.0001278 | 0.0000572 1.192309 
1.221849 1.0 2.443697 0.0002476 | 0.0004774 1.221601 





(a) Therefore, (pl1, 91) = (1.192437, 1.221849) and 
(p2, g2) = (1.192309, 1.221601). 


Solution of the linear System: J(Pk)dR = 三 (已 由 ) 















0.2 0.4 1.0 0.0904762 | _ 0.04 0.2904762 
0.2 1.0 0.4 0.0761905 | ” 0.06 0.1238095 
0.2904762 0.5809524 1.0 | | 0.0044128 | 10.0081859 0.2860634 
0.1238095 1.0 ”0.2476190 | | 0.0056223 | 10.0058050 0.1181872 





(b) Therefore, (pl1, 91) = ( 0.2904762， 0.1238095) and 
(p2, 92) 王 ( 0.2860634， 0.1181872). 

8. (b) The values of the Jacobian determinant at the solution points are |J(1, 1)| = 
0 and |J( 1，J)| = 0. Newton's method depends on being able to solve a 
linear System where the matrix is J(pn, gan) and (pn gr) is near a solution，For 
this example, the System equations are ill conditioned and thus hard to solve with 
precision， In fact, for some values near a Solution we have J(xo, y0) = 0, for 
example, (1.0001, 1.0001) = 0. 

12.(a) Note: As with derivatives, we have 于 (cf J) = c 二 Ce 由. 严 ( 卫 ) was 
defined as 忆 (下 ) = [ 户 (x 2) 户 (Cx ,xn)] ;thus,byscalar mmultipli- 


cation, c 下 (和 ) = [c 放 GD xn) cj sz] CECGE7 = [imxnm 

Where ji 一 CA， .2X1)) 一 ci .….,Xn). Therefore, by the def- 
K 

inition of scalar multipljication, we have J(cF(X)) = cJCF(Z)). 
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Section 4.1 Taylor Series anq Caiculation of Functions 


1. (a) 户 (x) =x xz3/3!1 十 X51! 
PCt) 一 X  X3/31 十 X57131 271T1 
症 a) =x 23/31+X51S1  x7]T1 十 X2/9! 
(pb) |Eo9(Co)| = |sin(c)xl0/10!| < (DCDIO/10! 二 0.0000002755 
(@@ 疡 =2 +G 0 CC /2/2 CC /4)316 
+ 人 rr/441/24+( 人 /45351120) 


3. Atxo = 一 0the derivatives of f (xz) are undefined. But at xo 一 1 the derivatives are 
defhined. 


S. 户 (x)=1+Or xx2/2+0r3=1 2x2/2 
8. (a) 7C) = 2, 六 2) = 革 六 2) = 而, F9) = 高 
户 (00)=2+GO 2)/4 (人 2)2164 二 人 2)31S12 
(b) 户 (1 = 1.732421875; compare with 312 一 1.732050808 


(人 ]) Fo) = 15(C2 十 口 72116; the minimum of | fx on the interval 
1<x<3occurs whenxr 一 1and|foo)l < |F9CO)I < 3 72(15/116) 


4 
0.020046. Therefore, |E3()| < 人 = 0.00083529 
13. (d)， 户 (0.5) = 0.41666667 14. (0) 忆 (0.5) = 1.21875000 
(0.5) = 0.40468750 局 (0.5) = 1.22607422 
书 (0.5) = 0.40553230 应 (0.5) = 1.22660828 
ln(1.5) = 0.40546511 (1.5J172 = 1.22474487 


Section 4.2 ”Introduction to Interpolation 


1. (a) Usex 一 4andget 3 三 0.02, 0 = 0.02,51 = 0.12, 0 = 1.18. Hence 
P(4) = 1.18. 


(bp) Usexr 一 4andget 吃 = 0.06,di = 0.04,d = 0.36. Hence P'(4) = 
0.36. 


(@) Usexz 一 4andgeti 一 0.00$, 5 = 0.01333333, ji = 0.04666667， 


iL 三 1.47333333, i0 = 5.89333333. Hence 7(4) = 5.89333333. Similarly, use 
X 一 1andget7(1) 三 1.358833333. 


六 Po)Jdx 三 7(4) 7() = 3S.89333333 1.$8833333 = 4.305 


(9 Usex = S.5and get jb = 0.02,5 = 0.01,51 = 0.255, 50 = 0.2575. 
Hence P(5.3) = 0.2575. 


ANSWERS TO SELECTED EXERCISES 641 


Section 4.3 Lagrange Approximation 
1.(a) 户 (x) 一 1 的 @ 全 一 本 0) 
X . 大 X 十 1 
mw oO0= CTOcT TD+ TD 0 
= 0.SO)C 1HD+0.50c)G 二 TD 一 0x2 二 xz 十 0 一 > 

Go) Hb 2) CC 十 1 2) 

也 一 ] 一 一 -一 一 一 一 一 一 一 一 -一 
人 六) TDCa0 本 1 OCT 


CE+DCDOC Das+oxz4or+o 二 站 


人 )(2)(1 
(0 Po)=1lc 2 2)+8x DC D=7r 6 


(xj  I (GCC 有 2 
一 0 一 一 一 一 一 -~ -一 -一 一 
(e) 疡 (x) 十 DC 十 8 四 3x2 2x 


S. (oO (co = 120(c 1l)forallcithus FE3(r) 一 SC+l)O)G 3)0 4(c DT 
10. |fO(col<| sin()| = 0.84147098 = 1 
(a) 121MN218 一 有 2(0.84147098)18 < Sx10 ? 
12. (aj) z 一 3 27 十 47 


Section 4.4 ”Newton Polynomials 
1 PoJ=4 G DT 
PC)==4 (人 iD+04x Do 3) 
PC) 一 已 (x) 二 0.01(x DG 3 4) 
PIC) 一 户 (x) 0.002(x Da 3) 4) 4.3) 
户 (2.5) = 2.3, 户 (2.5) = 2.2, 户 (2.5) = 2.21125，P4(2.2) = 2.21575 
S， cz) = 3(2)z 
P4) 三 1.3+1.5Cx 十 1 十 0.75(c 十 DOx) 二 0.25(x 十 DGx)(x 1 
十 0.0625(x 二 TI Dex 2) 
Pi(1.3) = 9.25, 忆 (1.3) = 8.0623, 户 (1.5) = 8.5312$，P4(1.5) = 8.47265625 
7 je) = 3.6/x 
PC)=36 18x 1D+06x DG 2 0.1SCx lo 2 3) 
十 0.03(xK UDC 2 3) 4) 
疡 (2.5) = 0.9, 忆 (2.5) = 1.35, 户 (2.5) = 1.40625, 疡 (2.5) = 1.423125 


Section 4.5 Chebyshev Polynoimiajls 


9 (a) ln(Gx 十 2) % 0.69549038 十 0.4990S042x ”0.14334605x2 十 0.04909073x3 
) IfGOCDOMC340) < 6/C3(040) = 0.03125000 
11. (a) cos(xz) 色 1 “0.46952087x? 
(b) 1AG ColC22G30) < 1sin(DI/(22(30) = 0.03506129 
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13. The error bound for Taylor's polynomial is 
LDOCoDl _ lsin(Dl 

8! ”8 
The error bound for the minimax approximation is 


LO _ lsin(D| 
27(80 一 27(80 


三 0.00002087. 





一 0.00000016. 


Section 4.6 ”Pade Approximations 


[ 
1 1 po1I+9=P5+4=0941== >，P1 一 
e SRIIGC)=(2 二 2Z)NC2 2 


1 2 2 
3. 1 = p0， 了 十 291/1S = Pl1， 五 十 917/3 = 0,.91 三 3 P1 


5. 1= po,1+9gI 一 PH 二 91 十 和 = 
5 十 生 十 0 =0 

First solve the system 1 辣 本 1 
， 124 61 2 1 

Thengl = 有 2 一 五 ,让 一 二 D2 三 行 . 


1 2 
7，(3) 1 一 po 了 +941=P 行 十 93 十 92 = 2 


First solve the system 
6 1791 ，242 
2835 3 拒 1 


4 
Then 91 = 5 和 一 古 一 5 P2 = 5 


Section S.1 ELeast-sqguares Line 
1.(a) 104 二 0B8= 7 
04 二 SB58=13 
yy 三 0.70x 十 2.60, 有 2() 0.2449 
2. (a) 404 十 0 下 一 S8 
04 二 5 有 刀 =31.2 
?了 三 1.4Sx 十 6.24, FE2( 鳃 0.8958 


5 
3. (oO 》 xx / 》 砚 = 86.9/55 = 1.58 
大 一 1 天 一 1 


7 三 1.38x, 52(P) 之 0.1720 
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11. (a) y = 1.6866x2, E2(CF) 1.3 
y = 0.5902x3, E2 (让 s 0.29， This is the best fit. 


Section S.2 ”Curye Fitting 


1.(a) 1644 十 20C = 186 
20B = 34 
204 十 4C= 26 


?一 0.875x2 1.70x 十 2.125 一 7/8x2 17/10x 十 1778 
3. (a) 154 十 58 = 0.8647 
S4 二 5B3 = 4.2196 
y 一 3.8665e 05084x,， EC( 门 之 0.10 








Using linearization Minimizing least squares 





四 1000 1000 
1 十 4.3018e 0802 1 十 4.2131e 1.0456! 
$000 5000 


(D) 


1 十 8.9991e 0.81138: 1 十 8.9987e 0.81157r 


18. (a) 144 十 15B 二 8C 一 82 
154 十 19B8 二 9C 三 93 


84 二 9B8+5C 一 49 
4=2.4,5=12,C 一 38yieldsz 王 2.4x 十 1.27 十 3.8. 


Section S.3 Interpolation by Spline Functions 


4. ho=1 do= 2 
Ai 一 3 丰 二 ] &U1 一 18 
A2=-3 d= 2/3 xi = 10 


15 
广 11 十 mi2 一 21 
Solve the system 二 2 ”1 to get ml = 314 = 
olve cao 的 15 oO get mi1 0 and 72 
Then 7z0 三 移 and 1103 一 纤 . The cubic spline is 
129 230 
So0=jnc+3 GCC+3 CT+T3) 十 2 3<xx< 
274 1S7 96 
SI = 一 十 2 + 一 二 22 一-( 十 2 
100) 305C 十 ) 十 TOTC 十 ) 10T 人 十 ) 2<X5<1 
779 117 72 
SO0= 一 -0 3 一 -or 02+- 一 (or TD+3 1<x<4 


2727 101 303 


643 
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s. ji=l1 du > 
由 = 一 3 丰 一 1] U1 一 18 
12=3 = 23 必 = 10 


8z21 十 31z2 一 18 
Solve the System 1 2 to get 101 一 站 and 12 一 


3m1l 十 127112 一 10 
Set /0 = 0 = 凡 3. The cubic spline is 


SoGD = 号 人 十 3 二 CA+3)+2 3 <x 工 
190 3 41 ) 92 
-一 一 一 2 2 < 1 
S1(r) 3 信 十 匀 十 区 十 丽人 性 十 ) <X 苹 
67 3 67 ) 76 
92(x) 一 3 页 人 1)” 十 了 贡 C 1) 十 3 1<x<4 


S. 10=1 d=- 2 
万 1 一 3 d 一 1 1 一 18 
j2 一 3 必 = 2/3 反 10 
学 mi1 十 mm2 一 18 
Oil 十 18m2 一 10 
Then mo = 现 = 和 3. Th ic spline i 
0 一 二 andm3 王 也 .TIhe cubic spline is 


Solve the system | to get 11rl 一 从 and 7j2 一 


37 3 187 ) 841 
So(x) 一 557(C 十 3) 十 5 十 557(x 十 3) 十 2 3<X< 
37 3 263 2 17 
_ 一 一- < 
S1Cr) 5 十 2 + 57 十 林 信 十 力 2<x<l1 
37 3 5 ) ，125 
S2(x) 一 57 (C ]) 苯 Cc 1 十 本 人 1) 十 3 1<x<4 


Section S.4 ”Fourier Series and Trigonometric Polynomials 


上 JoD = 生 (sin(0D + 到 喇 + 种 生 二 2 和 9 二) 


3 = 革 十 开 中 (二 六 ) cas 开 2 (二 )sin0a) 
SF(z) 一 竺 (sinm 到 和 + 到 到 ”2 殉 2 + 
12. fo0 =6+ 关 IF (CC 党 )eos( 尝 ) 
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Section 6.1 Approximating The Derivative 


1，F(x) 一 Sin(x) 


Approximate P(x)， Error in the 
formula (3) approximation 


0.695546112 0.001160597 
0.696695100 0.000011609 
0.696706600 0.000000109 








Bound for the 
truncation efror 


0.001274737 
0.000012747 
0.000000127 













3， (xx) 一 Ssin(x) 


Approximate (zx)， Error in the 
formula (10) approximation 









Bound for the 
truncation error 










0.696704390 0.000002320 0.000002322 
0.696706710 0.000000001 0.000000000 





: 5. Jon = oa (PC2) = 12.0025000 PC) sx 12.0000000 


(e) For part (89): 0O(1) 一 (0.05)2FG(c)/6 一 0.0025000，For part (b): 
O(4) = (0.05)4FG)i(c)130 = 0.0000000 


7. JJ= 王 xy 十 DJ 
(a) 户 (Cr,y) = (Ac 二) 户 2,3) =0.36 









Error in the 
approximation 





Approximation to 


户 (2， 3) 


0.360144060 
0.360001400 
0.360000000 


Approximation to 


0.160064030 
0.160000600 
0.160000000 


















Error in the 
approximation 










10. (a) Formula (3) gives 7 (1.2) 羡 13.5840 and 巨 (1.2) 光 11.3024. Formula (10) 
gives 77(1.2) 富 13.6824 and 巨 (1.2) 11.2975. 
(m) Using differentiation rules from calculus, we obtain 1/(1.2) 盖 ”13.6793 and 
瑟 (1.2) 六 11.2976. ， 
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App. F(o)， Error in the 

equation (17) | approximation 
0.93050 0.00154 
0.93200 0.00004 
0.93000 0.00204 


15， (xz) = cos(x),FO(z) 一 sin(x) 
Use the bound | fG)(r)| < sin(1.4) 盖 0.98545. 


App. Fn)， Error in the 

equation (22) | approximation 
0.93206 0.00002 
0.93208 0.00004 
0.92917 0.00287 


Section 0.2 ” Numerical Differentiation Formulas 


12. 







Equation (19), total error bound 
round-off| 十 |trunc,| 


0.00005 十 0.00161 = 0.00166 
0.00050 十 0.00002 = 0.00052 
0.00500 十 0.00000 = 0.00500 














Equation (24), total error bound 
|round-off| 十 |trunc.| 


0.00008 十 0.00000 = 0.00008 
0.00075 十 0.00000 = 0.00075 
0.00750 十 0.00000 = 0.00750 





1， 太 xz) = ln(r) 
(al) (5) 扩 0.040001600 (b) j”(S$) ”0.040007900 
(C) 7" (3) 多 ”0.039999833 (d) jj"(S3) = 0.04000000= 17S? 
The answerin part (b) is most accurate. 
3. fx) = 一 lIn(Cxr) 
(a) (5) 0.0000 (b) jjF7(S) 之 ”0.0400 
(c) 7”($) s% 0.0133 (d) jj"(S) = 0.0400 = 1/5? 
The answerin part (b) is most accurate. 


S,，(a) FGxz) 王妃 ，P"(D s 2.0000 
(b) Fo) = x4，F"(GD s 12.0002 


9.(a) 






0.141345 
0.041515 
0.058275 
0.158025 


AN 
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Section 7.1 Introduction to Quadrature 


1 


。(aj jx) 一 Sin(TrX) trapezoidal rule 0.0 

Simpson's rule 0.6606667 

Simpson?s rule 0.649519 

Boole's rule 0.636165 

(c) fxz) 三 sin(Wz) trapezoidal rule 0.420735 
Simpson's rule 0.373336 

Simpson's rule 0.583143 

Boole's rule 0.$93376 

2. (3) (xx) 一 Sin(rx) Composite trapezoidal rule 0.6035S5S3 
Composite Simpson rule 0.638071 

Boole's rule 0.636165 

(b) jxz) = Sin(V) Composite trapezoidal rule 0.377889 
Composite Simpson rule 0.$S92124 

Boole's rule 0.$S93376 


Section 7.2 《Composite ITrapezoidal and Simpson's Rule 


1 


(a) 下 (x) 三 arctan(x),F(D FE(O TD 三 T/2 居 1.37079632679 

人 1): M = 10, 关 = 0.2,7 了 ( 户 由 = 1.$6746305691, ET(FP) 三 0.00333326989 
(加 : M = S$, 关 = 0.2,.5( 记 1 = 1.37079538809, ESs( 太 月 = 0.00000093870 

(@] FE) 一 2wVXFG4) 天 坊 =3 

人 D: M = 10, 有 =0.37S.7 了 ( 户 站 = 王 3.04191993765， 

ET7( 记 1 一 0.04191993765 

( 动 : M = S$, 关 = 0.373,5( 放 PP) = 3.00762208163， 瑟 S( 站 Ai) 王 0.00762208163 


. (a) 万 VI 二 9xz4dx = 1.54786565469019 
个: M = 10,T(F 1/10) = 1.5$260945S 
(如 : M = 5, S( 帮 1110) = 1.$4786419 
. (a) 2z 用 xz3VI 十 9x4dx = 3.5631218520124 
GD: M = 10,T(A 1/10) = 3.64244664 
人间 : M = 5$, SC(F 1/10) = 3.$6372816 
(3a) Use the bound |FO(xz)| =| cos(z)| < 1cos(0)| = 1, and obtain 
(Cr/3 0)jp27]112 < 5x 10 9;then substitute 瑚 一 /(3M) and get 3/162 x 
108 < M2. Solve and get 4374.89 < Mi since M mnust be an integern M = 4375 
and 及 一 0.000239359. 


。、(3) Use the bound | Cr| 一 |cos(x)| < | cos(O)| = 1 and obtain 


((Cr/3 0)7P4)/180 < Sx10 9;thensubstitute 瑚 一 T/(6M) and getz5/34,992x 
107 < M4; since M must be an integer, M = 18 and 六 = 0.029088821. 
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10. 
ET(/ 月 = Oo) 















1 0.1990008 0.0006660 
2 0.1995004 0.0001664 
4 0.1996252 0.0000416 
8 . 0.1996564 0.0000104 
6 | 0.0125 | 0.1996642 






Section 7.3 Recursive Rules and Romberg Integration 
1. (3) 


0.84845691 











2.88 
2.10564024 
1.78167637 










1.84752031 


1.67368841 | 1.66209962 





10.(i For 帮 WVX dxr，Romberg integration converges slowly because the higher 
derivatives of the integrand (xz) = wx are notbounded nearx = 0. 


Section 7.$S ”Gauss-Legendre Integration (OptionalD) 
1 帮 65d = 人 G(A2)= 538.6666667 
3. 用 sinG)/tdt sx 0.9460831 。” () G(f.2) = 0.9460411 


6. (a) N 一 4 (bD) N =6 

Jecn jco) 
135 90 

The truncation error term for the Gauss-Legendre rule will be less than the trun- 

cation error term for Simpson's rule. 








8. If the fourth derivative does not change too much, then 


Section 8.1 Minimization of a Function 


3. (8) Fr)=4xz3 8xz 1llr 十 5; Po =12x2 16r 11; 
、local minima at x 一 县 
(d) Co = ez/x2; PCxc) =er(r 2)/x3;local minimaatxy =2 
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7， 


了 | 


(a) jc, 放 =xz 二 中 3xr 3y 十 5 


Pocy)=3z 3, 记 Ce 人) 一 37 ”3 
Critical points: (1, 1D), (1， 1 (11 (0 1， 了 1 
Local minimum at (1，1) 
(Fo 凡 =x2y 二 2” 3x? 
户 (Cr, 妨 =2xy 十 六 3 万 ( 人 太一 环 二 257 37 
Critical points: (0 0), (0, 3), (3, 0), (1 1) 
Local minimum at (1, 1) 


“Reflecting”the triangle through the side 有 G implies that the terminal points 
of of the vectors , M, and 尺 all lie on the same line segment，Thus, by the 
definition of scalar multiplication and vector addition, we have 刃 钱 =2(0M 
厂 ) or 尺 王 2M 人 帮 . 


Section 9.1 Introduction to Differential Equations 


1 
10. 


13. 
1S. 
17. 


(b) 工 =1] 3. 中 ) 工 =3 sS. (D) 工 三 60 


(c) No, because 户 (, y) = y 2/3 is not continuous when lt = 0， 


y( 人 三 扫 cos( 十 3 
y(I) 一 万 e 5 2ds 
(b) y() = yoe 0000120568&8  (@j 2808 years (dg) 6.9237 seconds 


Section 9.2 Euler's Method 


1 


3. 


(3) 


(3) 
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6. PH 一 玫 +(0.02P 0.00004P2)10for = 1 2, .8. 










Euler with more 
digits carried 


76.1 


Actual population 
at 不, 已 (大 ) 













1910 89.0035 
1920 103.6356 
1930 120.0666 
1940 138.3135 
1950 158.3239 
1960 179.9621 
1970 203.0000 

227.1164 


9. No，Eor any M, Eulers method produces 0 < 1 < 岂 < < JW The 
mathematical solution is y(1) = tan(f) and y(3) < 0. 


Section 9.3 Heun's Method 











1 (3) 
KK (P 一 0.2) 

0 1 

0.1 0.90S50 

0.2 0.82193 0.82400 

0.3 0.75014 

0.69093 0.69488 

3.(3) 







0.99500 
0.98107 
0.9S96 
0.92308 


0.98000 


0.92277 


7. Richardson improvement for solving y = (人 yy)/2 over [0, 3] with y(0) = 1. 
The table entries are approximations to y(3). 
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人 4 六 2013 











1.732422 


172 1.682121 1.665354 
1/4 1.672269 1.6608985 
/8 1.670076 1.669345 
1/106 1.669558 1.669385 
1732 1.669432 1.669390 


1.669401 1.669391 


8. y = Fly)=153713 万 (D = 0.5y 203. 户 (0,0) does not exist. 
The LI.V.P is not well-posed on any rectangle that contains (0, 0). 


Section 9.4 Tayior Series Method 











1， (3) 
其 =0.2) 
T 
0.1 0.90$16 
0.2 0.82127 0.82127 
0.3 0.74918 
0.68968 0.68968 
3， (3) 


1 







0.1 0.99501 
0.2 0.98020 0.98020 
0.3 0.96000 


0.92312 0.92313 


6S1 


6. Richardson improvement for the Taylor solution y = (人 /2 over [0, 3] with 


y(0) = 1. The table entries are approximations to y(3). 






(10 六 六 有 间 /115 







1.6701860 
1.6694308 
1.6693928 
1.6693906 


1.6693805 
1.6693903 
1.6693905 
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Section 9.S Runge-Kutta Methods 










1.(a) 
其 = 人 (六 =0.2) 
1 

0.90S16 

0.82127 0.82127 

0.74918 

0.68968 0.68969 
3. (3) 


了 次 = 人 =0.2) 


1 







0.99501 
0.98020 
0.95600 
0.92312 


0.98020 


0.92312 


Section 9.6 ”Predictor-Corrector Methods 


1 y4 = 0.82126825S, 7y5 一 0.78369923 
3. J4 = 0.74832050, y5 = 0.66139979 
4 y4 = 0.98247692, y5 三 0.973S0099 
7. 中 = 1.1542232，X5 一 1.2225213 


Section 9.7 ”Systems of Differential Equations 
1. ( 雪 (xl y1) 一 ( 2.5300000, 2.6700000) 
(xr2, 2) 一 ( 2.4040735, 2.$S485015) 
(b) (xl, yl) 三 ( 2.5$21092, 2.6742492) 
S. (bj) x = 
多 一 1.5xz 十 2.537 十 22.5e 
(c) xl 一 2.05,x2 = 王 2.17 
(d) xl 三 2.0875S384 
Section 9.8 Boundary Value Problems 
2. No;d() = 1/ 己 < 0forallr es [0.5, 4.5]. 


Section 9.9 ”Finite-dqifference Method 
1. (3) /1 = 三 0.$, xl 一 7.28$7149 
12 = 0.23, xl = 6.0771913, xz2 = 7.2827443 
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2.。(3) /1 三 0.3, xl = 0.853414295 
/2 = 0.29, xl = 0.93924622, x2 = 0.83762911 


Section 10.1 Hyperbolic Equations 







0.475528 
0.181036 


0.S00 | 1.000 
0.500 | 1.000 | 0.875 | 0.800 
0.375 






3. 









0.587785 | 0.951057 | 0.951057 | 0.$87785 
0.475528 | 0.769421 
0.384710 | 0.622475 | 0.622475 


0.475528 
Section 10.3 了 liptic Equations 









0.384710 


1. (a) 4PI 十 P2 十 P3 = 一 80 
P1 4P2 二 P4= 10 
P1 4p3 十 p4= 160 


P2 二 pa 4p4= 90 
(b) Pl = 41.25, p2 一 23.75, p3 = 61.25, p4 = 43.75 
S. (a) Uxz 二 xyy 一 24 十 2c=0,ifa= <c 


6. Determine 这 wx (xz, y) 一 cos(2x) 十 sin(2y) is a solution, since it is also defined on 
the interior of R; that is, xxzx 十 xyy 一 4cos(2x) 4sin(2y) 一 4(cos(2x) 十 
sin(27y)) 一 40. 


Section 11.1 Homogeneous Systems: The FEigenvalue Problem 


1. (a) 14 XI= 和 3 4=0implies that 和 li 一 1and)2 二 4.Substituting 
each eigenvalue into |4 和 X7| = 0 and solving gives Y1 = [ 1 1] and ;= 
[2/3 ]]， respectively. 
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10. 玉 和 一 2is aneigenvalue of 4 corresponding to the vector Y, then 4VY = 27. 
Premultiply both sides by 4 1: 4 14Y7 = 4 ICVY)ory = 24 1VY. Thus 
4 1VY = IV. 


Section 11.2 Power Method 


1 (4 ca1Y=4Y afyY=4Y7 ay= 和 YY ay=( ay.Thus( oa)， 
Y is an eigenpairof 4 oa7. 





0.2 ”0.3 
S,. (a) |4 17| = 02 0 一 0 
0.2 0.3 0|， . 0.2 0.3 0 
(D) | 02 03 1 iequivalentto| 0 000 thus 0.2x 二 0.37 = 0. 


Let 》 = 1 then x = 3/2， Thus the eigenvectors associated with 和 = 1 are 
{t[3/2 1] :re8%r 天 0]. 


(c) The eligenvectorfrom part (b) implies that in the long run the $0,000 members 
of the population will be divided 3 to 2 in their preference for brands 天 and 了 ， 
respectively; that is, [30,000 20,000] . 

Section 11.3 Jacobi'xs Method 


3. (a) The eigenpairs of 4 一 1 中 are 9?， [2 ]]， and 2， [ 1/3 1]. Thus the 


general solution is 筷 (1 站 ) = clez [2 二 十 c2e 24[ 173 1] . Set 一 0to solve 


for cl and cz; thatis, [1 ?] = cl[f2 +c[f LU3 二 .Thuscl = 0.7143 and 
cz = 1.2857. 


Section 11.4 Eigenvalues of Symmetric Matrices 


1.， From (3) we have 柱 == 全 杂 ， and, from Figure 11.4, Z = 地 ( 下 十 卫 ). 


Taking the dot product， 
X 了 1 (站 玉 . (和 十 了) 
-一 一- .二 (第 十 YY) 一 一 -一 
TS 
时 . 下 十 着 ,了 了 .了 .7 IEIP2 1 7 _0 
2 一 了 | 2 天 了 lz 


since 不 and 了 have the same norm. 
2. 忆 一 (2 居 时 ) 一 了 2( 下 大 ) 一 了 2( 天 天 一 了 2 和 于 一己 
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人 A 
Accelerating Convergence 
Aitken's process, 90, 99 (#10-#14) 
Newton-Raphson，71，82，88 ( 殷 3)， 
176 
Steffensen's method, 90,95 . 
Adam-Bashforth-Moujlton method， 474， 
482 
Adaptive Quadrature, 382, 387 
Aitken's process, 90, 99 (#10-#]14) 
Approximate Significant digits, 25 
Approximation of data 
least-squares curves, 211, 257 
least-squares line, 293, 258 
least-squares polynomial, 271, 274 
Approximation of functions 
Chebyshev polynomial， 230，233， 
238, 240 
Lagrange polynomial, 207, 211, 213， 
217, 238 
least squares, 2$4, 2$7, 271 
Newton polynomial, 220, 224, 227 
Padek approximation, 243, 246 
Tational functions, 243 
splines, 280,. 281, 285, 293 
Tayior polymomials, 8, 26, 31, 189 


Augmented Imatrix, 126, 129 


了 
Back substitution, 121, 123, 136 
Backward difference, 334 
Basis, SS$7 
Binary numbers, 13, 17, 19 
Binomial series, 197 (#14) 
Bisection method, S3, 94, S9 
Bolzano's method, S3 
Boole's rule, 344, 372，375, 380 ( 扫 ,， 抽 )， 


389 ( 抬 ) 
Boundary value problems，497，5303, 505， 
510 
Bracketing methods, S1, S3 
C 
Central difference, 313, 314, 329, 340 (#7， 


牛 ) 
Characteristic polynomial, SS$9 
Chebyshev nodes, 232 
Chebyshev polynomial 
interpolation, 230, 233, 238, 240 
minimization, 233 
nodes, 234 
Chopped number, 27 


ANore: Numbers in Parentheses refer to problem numbers in exercises. 


65SS 


65S6 INDEX 


C[a,D],3 
Cormposite Simpson's tule, 3$0, 354, 35S9， 
363 
Composite trapezoidal rule, 3S0, 354, 358， 
363 
Computer accuracy, 21 
Continuous function, 3 
Convergence 
acceleration，82，87 (把 1-#23)，90， 
92, 9 
criteria, 62. 06 
global (local), 62 
linear, 76, 77, 90 
Newton-Raphson，77，82，87 (过 1， 
#23) 
order of, 32, 75 
quadratic, 76, 77, 82, 87 ( 殷 1 殷 3) 
sequence, 3 
Series, 8, 99 (#10-#14) 
Speed, 75 
Corrector formula, 47S, 477 
Crank-Nicholson method, 931, S35 
Cube-root algorithm, 86 (#11) 
Cubic spline 
clamped, 284, 285, 293 
natural, 284. 285 


D 
DAlembert's solution, $19 
Deftation of eigenvalues, 978 
Derivative 
definition, 9, 311 
formulas，204，313，322，329，333， 
S05, 917, S27, 538 
higher 329, 333, S05 
partial, 325 (#7), S17, 927, S38 
polynomials, 204, 334, 336 
Determinant, 113, 114, 123, 1S1 
Difference 
backward, 334 
central, 313, 314, 329, 340 (#7, 枚 ) 
divided, 223 
finite-difference method，S0S，S10， 
414, 917, S27, 939 
forward, 334, 341 (#13) 
table, 224 
Difference equation，$05$，S17，S27，531， 
539 
Differential equation 


Adams-Bashforth-Moulton method， 
474, 482 
boundary value problems，497，5S03， 
S05, $10 
Crank-Nicholson method, 531, 535 
Dirichlet method for Laplace's equa- 
tion, 949 
Eulers method, 433, 437, 440 
existence-uniqueness, 430 
finite-difference method，505$，5S10， 
5$14, S17, S27, S39 
forward-difference method, 928, S33 
Hamming's method, 484 
Heun's method, 443, 445, 448, 465 
higher-order equations, 490 
initial value problem，428, 430,，481， 
498 
Milne-Simnpson method, 477, 483 
modiftied Euler method, 465 
partial differential equations， S14， 
S$16, $26, S38 
predictor, 474, 477 
Runge-Kutta method, 458, 461，466， 
468, 488, 5S02 
Runge-Kutta-Fehlberg method，466， 
469 
Shooting method, 498, S03 
stability of solutions, 478, 481 
Taylor methods, 4S1, 4S2, 4S5 
Digit 
binary, 14, 17, 19 
decimal, 14, 19, 22 
Dirichlet method for Laplace's equation， 
S49 
Distance between points, 103, 162 
Divided differences, 223 
Division 
by zero, 74, 77 
Synthetic, 10, 200 
Dot product 103 
Double precision, 22 
Double root, 7$, 77, 87 (要 ]) 


玉 
Bigenvalues 
charactetistic polynotmial, 559 
definition, SS9 
dominant 5$68 
Householder's method, $94 


INDEX 


inverse power method, S73, 97$, 976 
Jacobi's method, 581 
power method, 968, 570, $73, 976 
CR method, 601, 606 
Eigenvectors 
definition, SS9 
dominant, S68 
Elementary TIow operations, 126 
Elementary transformations, 125 
Blliptic equations, S38 
Endpoint constraints for splines, 284 
Epidemic model, 442 ( 抱 ) 
Equivalent linear Systems, 125 
Error 
absolute, 24 
bound, 189, 194, 213 
compnuter 21, 27, 135 
data, 36, 203, 316 
differential equations, 437, 445, 452， 
462, 475, 477, S19 
differentiation, 313, 314, 316, 318 
integration, 344, 3S8, 3539, 377 
interpolating polynomial，189，213， 
238 


loss of signifticance, 28 
propagation, 32 
Telative, 24, 66 
Toot mean Square, 253 
ITound-off, 27 
sequence, 3 
stable (unstable), 33 
Subtractive cancellation, 28 
truncation, 26, 313, 314 
Euclidean norm, 103, 162, 163 
Euler formulas, 299 
Eulers method, 433, 437, 440 
global error 437 
Imodihted, 465 
Systems, 488 
Even function, 300 
Exponential ft, 263 
Extrapolated value,，199 
Extrema, 400, 404 
Extreme Value Theorem, 4 


了 
False position Imnethod, S6, 60 
Final global error, 437, 44$, 4S2, 462 
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Finite difference method，S0S$，S$10，5S14， 
517, 9327, 39 
Fixed-point iteration, 42, 49, 173 
error bound, 40 
Eloating-point number 21, 22 
accuracy, 21 
Forward difference, 334, 341 (#13) 
FEorward difference method, $S27, S28, S33 
FEorward substitution, 125 ( 殷 ) 
Fourier series, 299 
discrete, 304 
Fractions, binary， 17 
Fundamental theorem of calculus, 6 


G 
Gauss-Lesgendre integration, 389, 392, 394 
Gauss-Seidel iteration, 159, 161, 164 
Gaussian elimination, 125, 128, 143, 150 
back Substitution, 121, 123 
computational complexity, 147 
LU factorization, 141, 143, 1S0 
multipliers, 127, 129 
bivoting, 127, 131 
tridiagonal Systems，140 (#1)，166 
(要 ),， 284, 506, S99 
Generalized Rolle's theorem, 6, 198 (#20) 
Geometric series, 16, $1 
Gerschgorin's circle theorem, $66 
Golden ratio search, 401, 412 
Gradient, 412, 420 
Graphical analysis 
fxed-point iteration, 47 
Newton's method, 70, 78, 79 
secant method, 80 


了 
Halley's method, 87 ( 反 2P2) 
Hamming's method, 484 
Heat equation, $1S 
Helmholtz's equation, 538, S48 
Heun's method, 443, 445, 448, 465 
Higher derivatives, 329, 333 
Hilbert matrix,，139 (#15) 
Hooke's law, 262 (#1) 
Hormners method, 10, 200 
Householder's method, S94 
Hyperbolic equations, S16 


I 
Il-conditioning 
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least-squares data fttting，134 
matrices, 133, 139 (#]15) 
Initial value problem, 428, 430, 487, 498 
Jntegration 
adaptive quadrature, 382, 387 
Boole's rule, 344, 372, 37S,， 380 (#3， 
扒 )， 389 ( 扫 ) 
composite rules, 350, 3S4, 3S8, 363 
cubic spjines, 296 (#12) 
Gauss-Legendre integration， 389， 
392, 394 
midpoint rule, 366 (#12), 381 (#11) 
Newton-Cotes, 344 
Romberg integration，373，375，377， 
378, 381 (#11) 
Simpson's rule，344，3S3 (#o)，354， 
359, 363, 370, 380 (#6), 387 
Trapezoidal rule, 344, 3S4, 3S8, 363， 
368, 377 
JIntermediate Value Theorem, 3 
JInterpolation 
Chebyshev polynomials，230，233， 
238, 240 
cubic splines, 281, 28S-287, 293 
eIror，polynomials，8，31，189，211， 
213, 238 
extrapolation，199 
integration, 296 (#12), 344 
Lagrange polynomials, 207, 211, 213， 
217, 238 
least Squares, 295, 271 
linear 207, 219 (#12), 2$$, 277 (#17)， 
280 
Newton polynomials, 220, 224, 227 
Padk approximations, 243, 246 
Piecewise iinear, 280 
polynomial wiggle, 273 
rational functions, 243 
Runge bhenomenon, 236 
Taylor polynomials，8，26，31，189， 
313, 329 
trigonometric polynomials, 297,， 303， 
306 
Iteration methods 
bisection, S3, 54, S9 
fxed point, 42, 49,，173,，544 
Gauss-Seidel, 199, 161,， 164 
Jacobi iteration, 1$6. 161, 163 
Muller 92, 97 


Newton，70，82，84，88 (把 3)，176， 
179 

partial differential equations, S46 

iegula falsi, 96, 60 

secant, 80, 84, 87 (#20) 

Steffensen, 92, 95 


圳 
Jacobi iteration for linear Systems，156， 
161, 163 
Jacobis method for eigenvalues, 581, 390 
Jacobian matrix，170, 176 


工 
Lagrange polynomials, 207, 211, 213, 236 
Laplace's equation, S38, S49 
Least-squares data fitting 
data linearization, 266 
linear ft，2$9，238，260 (所 )，277 
{#17) 
nonlinear ft, 297, 266, 271 
plane, 277 (#17, #18) 
polynomial fit, 271, 274 
Ioot-mean-square error, 253 
trigonometric polynomijals, 297, 303， 
306 
Length of a curve, 364 (把 ) 
Length of a vector 103, 162, 163 
Limit 
function, 2 
Sequence, 3 
series, 8 
Linear approximation, 219 (#12), 2$5, 258， 
277 (#17), 280 
Linear combination，103, 499 
Linear Convergence, 76, 77, 90 
Linear independence, SS7 
Linear least-squares ft 25$, 2S8, 260 (#7)， 
277 (#17) 
Linear System，114，121，128，143，152， 
1S6, 163 
Linear Systems of equations 
back substitution, 121. 123, 136 
forward substitution, 125 (#2) 
GOaussian elimination，125，128，143， 
150 
LU factorization, 141, 143, 150 
tridiagonal Systems，140 (#)，166 
( 反 ), 284, 506, S99 


INDEX 


Linear Systems, theory 
matrix form, 111, 114, 127, 141 
nonsingular 114 

Lipschitz condition, 430 

Location of roots, 68 

Logistic rule of population growth，276 

(#, #7) 

Loss of significance, 28 

Lower triangular determinant，123 

LU factorization, 141, 143, 150 


M 
Machine numbers, 20 
Maclaurin series, 243 
Mantissa, 20, 22 
Markov process, 379 (#) 
Matrix 
addition，107 
augmented, 126, 129 
determinant, 113, 114, 123, 1S1 
diagonaiization, S63 
eigenvalue, 59 
eligenvector SS9 
equality, 106 
Hilbert, 139 (#15) 
identity, 112 
刘 -conditioned，133, 139 (#15S) 
inverse, 112, 114 
lower triangular 120, 125 ( 殷 ), 143 
LU factorization, 141, 143, 1S0 
multiplication，110, 112,， 143，15 
nonsingular, 112 ， 
norm, $66 
Orthogonal, S65, S94 
permutation, 148, 1S0 
Singuar 113 
strictly diagonally dominant， 160， 
162, 163 
symmetric，109 (#)，565$,， 5$81，590， 
S94 . 
Ianspose, 104、108 ( 反 ), 270 
triangular, 120, 125 ( 殷 ) 
tridiagonal，140 (#1)，166 ( 反 )，284， 
506, 999 
Mean of data, 260 ( 才 , 炮 , 折 ) 
Mean value theorems 
derivative, $, 45 
integrals, 6 
intermediate, 3 
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weighted integra, 7 
Midpoint rule, 366 (#12), 381 (#11) 
Milne-Simpson method, 477, 483 
Minimax approximation，Chebyshev，231， 
233, 238 
Minimum 
golden ratio search, 401, 412 
gradient method, 412, 420 
Nelder-Mead, 40$, 414 
Modiftied Euler method, 465 
Mullers method, 92, 97 
Mnultiple root 75, 82. 87 (要 1, 要 3) 
Multistep Imethods 
Adams-Bashforth-Moulton ”method， 
474, 482 
Hamming's merhod, 484 
Milne-Simpson method, 477, 483 


N 
Natural cubic splines, 284, 285 
Near-minimax approximation，231，233， 
238 
Nelder-Mead, 405, 414 
Nested Multiplication, 10, 221 
Neumann boundary conditions, $S41, $45 
Newton divided differences, 223 
Newton polynomijial, 220, 224, 227 
Newton systems, 176, 179 
Newton's method 
multiple roots, 74, 82, 87 ( 扫 1, #23) 
order of convergence, 77 
Newton-Cotes formulas, 344 
Newton-Raphson formnula，82，84，88 
(#23)， 176, 179 
Nodes, 203, 207, 211, 213, 234, 344, 389 
Norm 
Euclidean, 103, 162, 163 
matrix, 966 
Normal equations, 2S 
Numerical differentiation，313，314，320， 
329, 333 
backward differences, 334 
central differences，313，314，329， 
340 (#7, #8) 
error formula, 313, 314, 316, 318 
forward differences, 334, 341 (#13) 
higher derivatives, 329, 333 
Richardson extrapolation, 320 
Numerical integration 
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adaptive quadrature, 382, 387 

Boole's rule, 344, 372, 375, 380 ( 扫 ， 
后), 389 ( 扫 3) 

composite nules, 330, 3$S4, 358, 363 

Cubic splines, 296 (#12) 

Gauss-Legendre _ integration， 389， 
392, 394 

Inidpoint rule, 366 (#12), 381 (#11) 

Newton-Cotes, 344 

Romberg integration，373，375，377， 
378, 381 (#11) 

Simpson's rule，344,，353 (#9)，354， 
359, 363, 370, 380 (二 ), 387 

Trapezoidal rule, 344, 354, 3S8，363， 
368, 377 


O 
O(1)，29，32，214，313，314，329，333， 
373，377，437,， 445，452，461， 
475, 477, 905, 517, 527, 538 
Odd function, 301 
Optimization 
golidena ratio search, 401, 412 
gradient method, 412, 420 
Nelder-Mead, 405, 414 
Optimum step size 
differential equations, 466, 476, 479 
differentiation, 316, 317 
integration, 338, 382 
interpolation, 213, 234 
Order 
of approximation，29, 32，214，313， 
329, 333, 373,. 377 
of convergence, 32, 75 
Orthogonal polynomials, Chebyshev 238 


P 
Pade approximation, 243, 246 
Parabolic equation, $S26 
Partial derivative, 517, 527, 538 
Partial differential equations，S14，516， 
S26, S38 
elliptic equations, S38 
hyperbolic equations, 516 
parabolic equations, 526 
Partial pivoting,，133 
Periodic function, 298 
Piecewise 
continuous, 298 


cubic, 281 
linear 280 
Pivoting 
element, 127 
TOow,， 127 
Strategies, 131, 133 
Plane rotations, 115, $81 
Poisson's equation, S38, S48 
Polynomijals 
calculus, 204 
characteristic, S$9 
Chebyshev, 230, 233, 238, 240 
derivative, 204, 334, 336 
interpolation，204，207，210，211， 
217, 224, 227, 238 
Lagrange, 207, 211, 213, 236 
Newton, 220, 224, 227 
Taylonr 8, 26, 31, 189, 313, 329 
trigonometric, 297, 303, 306 
Wiggle, 273 
Power method, 568, $70, S73, S76 
Predator-prey model, 495 (#13) 
Predictor-corector method, 474 
Projectile motion, 73, 442 (#8), 450 (#6) 
Propagation of error, 32 


Q 
CR method, 606 
Quadratic convergence，76，77，82，87 
(要 1 扫 3) 
Quadratic formula, 39 (#12) 
Quadrature 
adaptive quadrature, 382, 387 
Boole's rule, 344, 372, 375, 380 (#3， 
瓜 ), 389 ( 扫 ) 
composite rules, 3S0, 354, 3$8, 363 
cubic splines, 296 (#12) 
Gauss-Legendre integration， 389， 
392, 394 
midpoint rule, 366 (#12), 381 (#11) 
Newton-Cotes, 344 
Romberg integration，373, 375，377 
378, 381 (#11) 
Simpson's rule，344，353 (#9)，354， 
339, 363, 370, 380 (#6), 387 
Trapezoidal rule, 344, 354, 358, 363， 
368, 377 


9 


INDEX 


及 
Radioactive decay, 432 (#17) 
Rational function, 243 
Regula falsi method, 56, 00 
Relative error, 24, 66 
Residual, 167 ( 抹 ), 2S3 
Richardson 
differential equations，449 ( 反 7)，456 
{#6), 471 (#7) 
numerical differentiation, 320, 322 
numerical integration, 375 
Rolle's theorem, 59, 6, 198 (#20), 212, 219 
(#13) 
Romberg integration，373，375，377,，378， 
381 (#11) 
Root 
location, 68 
mujtiple, 75, 82, 87 ( 拉 1 态 3) 
of equation, $3, 75 
simple, 73, 77, 87 ( 抽 22) 
Synthetic division、10, 200 
Root fhinding 
bisection, 93, 54, 99 
Muller 92, 97 
multiple roots, 73, 82, 87 (所 1 殷 3) 
Newton, 82. 84. 88 (#23),， 176, 179 
quadratic function, 39 (#12) 
regula falsi, 46, 60 ， 
secant 80, 84, 87 (#20) 
Steffensen, 92, 95 
Root-mean-square erraor, 2S3 
Rotation, 11$, S81 
Rounding error, 27 
differentiation, 313, 314, 316, 318 
hoating point number 21 
Row operations, 127 
Runge phenomenomn 236 
Runge-Kutta methods, 458, 461, 466, 468， 
488, S02 
Eeblberg method, 466, 469 
Richardson extrapolation, 471 (#7) 
Systems, 488 


S 
Scaled partial pivoting, 133 
Schur, 463 . 
Scientific notation, 19 
Secant method, 80, 84, 87 (#20) 
Seidel iteration, 174, 179 
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Sequence, 3, 41 
CoOnvergenb 3 
error 3 
geometric, 16, 51 
Sequential integration 
Boole, 372,. 375 
Simpsom 370, 37S 
trapezoidal, 369, 375, 377 
Series 
binomial, 196 人 #10) 
convergence，8，99 (#10-#14)，189， 
194 
geometric, 16, $1 
Maclaurin, 243: 
Taylonr 8, 26, 31, 189, 313, 329 
Shooting method, 498, S03 
Significant digits, 25 
Similarity transformation, S82 
Simple roob 75, 77, 87 ( 认 2) 
Simpson's rule，344，353 (#9)，35S4，359， 
363, 370, 387 
three-eighths rule, 344, 3S3 (#9), 380 
( 折 6) 
Single precision, 22 
Single-step methods, 474 
Slope methods, 70, 80, 84 
SOR method, S45 
Spectral radius theorem, 566 
Splines 
clamped, 284, 285, 293 
end constraints, 284 
integrating, 296 (#12) 
linear, 280 
natural 284, 285 
Square-root agorithm, 72 
Stability of differential equations, 478, 481 
Steepest descent, 412, 420 
Steffensen's method, 92, 95 
Step size 
differential equations, 466, 476, 479 
differentiation, 316, 318 
integration, 398, 382 
interpolation, 213, 234 
Stopping criteria, $8, 62 (#13) 
Successive over-relaxation,， 545 
Surface area 364 ( 反 ) 
Synthetic division, 10, 200 
Systems 
differential, 487 
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linear，114，121，123，128，136，143， 
1S$0, 1S6, 163 
nonlinear, 167, 174 


T 
Tayler series, 8, 26, 31, 189, 313, 329 
Taylors method, 451, 452, 455 
Termination cfiterion 

bisection method. S8 

Newton's method, 84 

regula falsi method, S8. 60 

Romberg integration, 378 

Runge-Kutta method, 469 

Secant method, 84 
Transformation, elementary, 125 
Trapezoidal rule, 344, 3S4, 3S8，363, 369， 

377 

Triangular factorization, 141, 143, 149 
Trigonometric polynomials, 297, 303, 306 
Truncation error 26, 313, 314 


U 
Unimodal function, 402 
Unstable erronr 33 
Uppertriangularization, 136, 150 


WV 
Vectors 
dot product, 103 
Euclidean norm,，103, 162, 163 


WV 
Wave equation, S16, S19 
Weights, for integration rules, 344, 393 
Wiggle, 273 


Z 
Zeros 
of Chebyshev poiynomials, 232 
of functions, $3, 7 
root fnding, 40, S1, 70, 90, 167, 174 
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